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' Tliree  classes  of  multiple  stage  optimal  control  problems  are  studied. 
The  derived  results  are  applied  to  the  problem  of  toroidal  plasma  heating 
by  means  of  neutral  injection. 

First  a two-stage  optimal  control  problem  having  an  integral  coat 
functional,  whose  integrand  changes  its  form  at  an  unspecified  switching 
time,  is  considered.  An  existence  theorem  and  two  sets  of  necessary  _ 
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conditions  for  an  optimal  control  and  switching  time  are  derived  for  a 
general  two-stage  problem.  ^ 

The  two-stage'  problem  is  then  generalized  to  a multi-stage  problem 
where  the  integrand  of  the  cost  functional  can  change  from  one  form  to 
another  among  N given  forms  at  any  Instant  for  any  number  of  times. 

This  problem  is  shown  to  be  reducible  to  a standard  optimal  control 
problem  by  Introducing  a set  of  auxiliary  control  variables.  It  is 
shown  that  a chattering  control  may  be  encountered  due  to  the  nonconvexity 
of  the  augmented  control  constraint  set. 

Next,  the  fixed  k-stage  optimal  control  problem  is  examined.  For 
this  problem,  the  control  is  kept  constant  on  each  of  the  k prescribed 
subintervals  on  which  the  cost  functional  assumes  a different  form. 

This  leads  to  an  equivalent  parameter  optimization  problem  in  k-dimensional 
Euclidean  space.  A feature  of  this  finite  dimensional  formulation  is 
that  no  approximation  errors  are  introduced  in  the  discretization  of  the 
system  equations. 

The  problem  of  minimum  input  energy  plasma  heating  by  neutral 
injection  is  studied  utilizing  the  derived  results.  This  problem  is 
formulated  as  a two-stage  optimal  control  problem.  It  is  shown  that 
optimal  heating  is  achieved  by  an  on-off  neutral  injection  program  which 
is  characterized  by  a three  point  boundary  value  problem.  The  results 
on  the  fixed  k-stage  problem  are  also  utilized  in  characterizing  the 
optimal  piecewise  constant  neutral  injection  program. 

' The  optimal  heating  problem  is  reformulated  as  a multi-stage  optimal 
control  problem  using  a single-temperature  model  of  the  plasma.  The 
optimal  heating  program  is  shown  to  assume  one  of  three  possible  on-off 
forms,  depending  on  the  heating  time  duration. 

Finally,  the  stability  of  two  classes  of  ion  temperature  feedback 
control  systems  is  discussed.  The  results  suggest  the  possibility  of 
regulation  of  the  ion  temperature  using  feedback-controlled  neutral 
injection.  ‘ 
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Thi'ee  classes  of  multiple  stage  optimal  control  problems  are 
studied . The  derived  results  are  applied  to  the  problem  of  toroidal 
plasma  heating  by  means  of  neutral  injection. 

First  a two-stage  optimal  control  problem  having  an  integral 
cost  functional,  whose  integrand  changes  its  form  at  an  unspecified 
switching  time,  is  considered.  An  existence  theorem  and  two  sets  of 
necessary  conditions  for  an  optimal  control  and  switching  time  are  de- 
rived for  a general  two-stage  problem. 

The  two-stage  problem  is  then  generalized  to  a multi-stage 
problem  where  the  integrand  of  the  cost  functional  can  change  from 
one  form  to  another  among  N given  forms  at  any  instant  for  any  num- 
ber of  times.  This  problem  is  shown  to  be  reducible  to  a standard 
optimal  control  problem  by  introducing  a set  of  auxiliary  control 
variables.  It  is  shown  that  a chattering  control  may  be  encountered 
due  to  tlie  nonconvexity  of  the  augmented  control  constraint  set . 
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Next,  the  fixed  k-sta«e  optimal  control  problem  is  examined. 
For  this  problem,  the  control  is  kept  constant  on  each  of  the  k pre- 


scribed subintervals  on  which  the  cost  functional  assumes  a different 
form.  This  leads  to  an  equivalent  parameter  optimization  problem  in 
k-dimenaional  Euclidean  space.  A feature  of  this  finite  dimensional 
formulation  is  that  no  approximation  errors  are  introduced  in  the  dis- 


cretization of  the  system  equations. 

The  problem  of  minimum  input  energy  plasma  heating  by  neutral 
injection  is  studied  utilizing  the  derived  results.  This  problem  is 
formulated  as  a two-stage  optimal  control  problem.  It  is  shown  that 
optimal  heating  is  achieved  by  an  on-off  neutral  injection  program 
which  is  characterized  by  a three  point  boundary  value  problem.  The 
results  on  the  fixed  k -stage  problem  are  also  utilized  in  characteriz- 
ing the  optimal  piecewise  constant  neutral  injection  program. 

The  optimal  heating  problem  is  reformulated  as  a multi-stage 
optimal  control  problem  using  a single-temperature  model  of  the  plasma. 
The  optimal  heating  program  is  shown  to  assume  one  of  three  possible 
on-off  forms,  depending  on  the  heating  time  duration. 

Finally,  the  stability  of  two  classes  of  ion  temperature  feed- 
back control  systems  is  discussed.  The  results  suggest  the  possibility 
of  regulation  of  the  ion  temperature  using  feedback -controlled  neutral 
injection. 
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CHAPl’ER  I 
INTRODUCTION 

This  dissertation  consists  of  two  parts.  Part  1 is  devoted  to 
the  mathmatical  aspects  of  a class  of  optimal  control  problems  which 
are  motivated  by  the  problem  of  optimal  heating  of  toroidal  plasmas 
by  means  of  neutral  beam  injection.  In  fart  2,  the  derived  mathe- 
matical results  are  applied  to  plasma  heating  problems. 

1.1.  Optimal  Heating  Problem  of  Plasma  by  Means  of  Neutral  Injection 

In  toroidal  plasma  devices  such  as  Tokamak,  the  plasma  is  con- 
fined by  a strong  toroidal  magnetic  field  supplemented  by  a poloidal 
field  produced  by  the  plasma  current.  At  the  same  time  this  plasma 
current  raises  the  plasma  temperature  through  the  Joule  heating  effect. 
There  has  been  stme  hope  that  Joule  heating  alone  would  be  sufficient 
to  raise  the  ion  temperature  to  a high  level  such  that  a relatively 
low  power  ccniplementary  heating  source  would  be  enough  to  achieve  the 
ignition  temperature.  However,  from  the  recent  experiments,  it  has 
become  apparent  that  Joule  heating  is  insufficient  for  this  task 
and  auxiliary  heating  such  as  neutral  injection  may  have  to  play  a 
dominant  role  in  plasma  heating.  Since  the  energy  consumption  due  to 
auxiliary  heating  may  become  comparable  to  that  due  to  Joule  heating, 
it  is  important  to  operate  the  heating  system  at  a high  level  of 
efficiency. 

In  this  dissertation,  several  optimal  control  problems  motivated 
by  the  heating  problems  of  toroidal  plasma  devices  by  means  of  neutral 
injection  are  studied. 
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The  principle  of  neutral  beam  injection  heating  is  the  following; 
First,  the  energetic  neutral  be.'un  is  prohicej  by  neutralising  the 
accelerated  ion  beam  so  that  the  betun  can  penetrate  the  confining  mag- 
netic field.  The  injected  neutral  ptirticles  then  charge -exchange  with 
the  plasma  ion.s  to  prixJuce  fast  (hot)  pla;nna  ions  and  slow  (cold) 
neutral  particles.  In  a plasma  heating  experiment,  neutral  injection 
is  introduced  whenthe  plasma  temperatures  and  densities  ai*e  built  up  to  a 

sufficientl,v  high  level.  It  is  important  to  know  when  i;eutral  inject- 
ion shi-xild  be  Initiated  in  order  to  mirrimice  the  total  Injnit  energy’ 
while  achieving  the  desired  ion  temperature  within  a given  time  dura- 
tion. Suppose  the  experiment  starts  at  time  t r-  0 and  lasts  until 
time  t^,  and  neutral  injection  is  introduced  at  time  t^  t [O.t^,]. 
Then  the  total  energy  consmnption  can  be  expressed  as 

r''-  ^ 

c (total  energj')  = J (Joule  heating)dt  + J (neutral  inject ion)dt . 

" a.i) 

The  problem  of  miniBii;iing  (l.l)  with  respect  to  t^^  as  well  as  the 
neutral  injection  program  leads  to  an  optimal  control  problem  with  a 


t -VO- St  age  cost  notional  J given  by 


h S' 

J =r  J Lj^(x,u)dt  + J Lg(x,u)dt. 


(1.2) 


This  problem  will  be  referred  to  as  a two-stago  optimal  control  problem 
and  is  one  of  the  main  problems  considered  in  this  dissertation. 

Another  optimal  heating  problem  arises  frm  an  engineering  re- 
qviirement  that  tlie  neutral  beam  injection  program  be  such  that  the  betw. 
current  is  kept  constant  on  each  prescribed  subintervnl  of  the 


► 

f 

ft 
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experiment  time  interval  [0,t^].  This  is  due  to  the  fact  that  it  is 
difficult  to  vary  the  heam  current  continuously  in  time.  Moreover, 
the  changes  of  the  current  at  arbitrary  time  instants  are  not  easily 
implemented.  This  motivates  a fixed  k-stage  optimal  control  problem 
with  piecewise  constant  controls  and  a cost  functional  which  tedkes  on 
k different  forms  on  k given  subintervals. 

1.2.  Multiple  Stage  Optimal  Control  Problems 

The  distinctive  characteristic  of  the  two-stage  optimal  control 
problem  is  that  the  cost  functional  assumes  different  forms  before  and 
after  the  unspecified  switching  time  t^.  To  solve  this  problem,  we 
need  to  specify  not  only  the  control  u but  also  the  switching  time 
t^.  Two  necessary  conditions  for  an  optimal  pair  (u  ,tj^)  are  de- 
rived, one  by  means  of  calculus  of  variations  and  the  other  by  decom- 
posing this  problem  to  two  standard  optimal  control  problems. 

The  two-stage  problem  is  generalized  to  the  multi-stage  optimal 
control  problem  such  that  the  integrand  of  the  cost  functional  can 
change  from  one  to  another  among  N given  forms  any  number  of  times. 

This  problem  is  solved  by  reducing  it  to  a standard  problem  with  the 
help  of  auxiliary  control  variables. 

There  are  some  works  on  optimal  control  problems  having  system 
equations  with  discontinuous  right  hand  side  and  similar  problems 

k 

[10],  [11],  [12],  [13],  [2U],  [25],  [33],  1^3.].  However,  none  of  the  j 

t 

above  works  includes  the  treatment  of  a variable  intermediate  switch-  [ 

ing  as  a part  of  the  control.  Kleinman,  Fortman  and  Athans  [26]  | 

mentioned  the  problem  of  choosing  the  switching  times  as  a subject  of  1 

future  research  in  their  paper  on  a piecewise  constant  feedback  1 


u. 
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control.  In  a paper  by  Athans  on  the  optimal  measurement  strategies 
[l],he  adopted  a technique  sljiiileur  to  the  auxiliary  controls  dis- 
cussed here.  However,  he  did  not  discuss  the  possibility  of  chattering 
controls  which  is  Important  in  considering  the  optimal  multi-stage 
controls . 

The  fixed  k-stage  optimal  control  problem  is  solved  by  reformulat- 
ing it  as  a psu'ameter  optimization  problem  in  a real  k-dimensional 
Euclidean  space  H . Then  the  techniques  of  mathematical  programming 
are  applied  to  obtain  a characterization  of  the  optimal  solutions. 

The  optimal  control  problem  with  piecewise  constant  control  but  without 
the  assumption  of  a k-stage  cost  functional  has  been  studied  and  many 
standard  results  on  this  subject  are  available  [6],  (30],  [31].  A 
standard  approach  to  this  problem  is  to  reformulate  it  as  a discrete- 
time optimal  control  problem  and  apply  the  methods  of  matheniatical 
programming.  In  discretizing  the  continuous  system,  an  assumption  is 
usually  made  that  each  subinterval  is  sufficiently  short  so  that  the 
first-order  approximation  for  an  integration  on  each  sub interval  is 
satisfactory.  In  the  plasma  heating  problem,  the  assumption  of  small 
Sub intervals  would  lead  to  a very  rapidly  changing  neutral  beam 
current  which  is  undesirable  frcm  the  engineering  standpoint.  There- 
fore, we  do  not  adopt  this  assumption.  In  fact,  we  shall  not  use  any 
approximations  in  the  derivation  of  necessary  conditions  for  optimality. 

Although  the  approach  without  the  small  subinterval  approximation  is 
mentioned  in  many  texts,  for  example  [6],  [36],  among  the  references 
available  to  the  author,  none  have  given  an  explicit  optimality  condi- 

i 

tion  for  such  a case.  ‘ 
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1.3.  Outline  of  Dissertation 


In  Part  1,  consisting  of  Chapters  II,  III  and  IV,  a mathematical 
discussion  on  three  multiple  stage  optimal  control  problems  is  presented. 

The  two-stage  optimal  control  problem  is  formulated  in  Section  2.1 
and  the  existence  of  an  optimal  control  pair  is  discussed  in  Section 
2.2.  In  Sections  2.3  and  2,h  two  sets  of  necessary  conditions  for  an 
optimal  control  pair  are  derived  via  two  methods.  As  a special  case, 
a linear  regulator  problem  with  a two-stage  quadratic  cost  is  consid- 
ered in  Section  2.5-  A sufficient  condition  for  nonexistence  of  an 
optimal  intermediate  switching  is  also  discussed  for  this  problem. 

In  Chapter  III,  the  two-stage  problem  is  generalized  to  a multi- 
stage problem.  The  formulation  of  this  problem  is  given  in  Section 
3.1.  Subsequently  it  is  reduced  to  a standard  optimal  control  problan 
by  introducing  a set  of  auxiliary  controls.  The  existence  question  is 
discussed  in  Section  3*3«  fhe  possiblity  of  chattering  controls  is 
also  discussed  in  this  section.  A numerical  example  is  provided  to 
illustrate  the  case  when  a chattering  control  is  encountered. 

The  fixed  k-stage  optimal  control  problem  is  presented  in  Chapter 
IV.  The  basic  formulation  and  an  equivalent  parameter  optimization 
problem  are  given  in  Sections  4.1  and  4.2  respectively.  A necessary 
condition  in  integral  form  is  presented  in  Section  4.3, 

Part  2 is  composed  of  Chapters  V and  VI.  The  results  derived  in 
Part  1 are  utilized  in  analyzing  several  problems  of  plasma  heating  by 
means  of  neutral  injection.  Chapter  V is  devoted  to  a discussion  of 
the  minimum  input-energy  plasma  heating  problem  using  a two -temperature 
model  of  the  plasma  which  is  given  in  Section  5.1.  The  existence  and 
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the  characterization  of  an  optimal  neutral  Injection  heating  program 
are  discussed  In  Sections  5 *2  and  5.3  respectively.  The  discussion  of 
the  optimal  piecewise  constant  neutral  Injection  program  Is  then  pre- 
sented In  Section  5.^. 

A simplified  single-temperature  model  of  the  plasma  Is  adopted 
In  Chapter  VI.  The  minimum  injection  energy  problem  using  this  model 
is  formulated  in  Section  6.1,  where  the  existence  of  an  optimal  in- 
jection program  is  also  discussed.  The  characterization  of  the  optimal 
injection  program  is  given  in  detail  in  Section  6.2.  We  then  discuss 
the  dynamics  and  stability  of  various  ion  temperature  feedback  control 
systems . The  analysis  includes  the  effect  of  measurement  time-delay 
on  the  stability  of  the  total  system. 
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CHAPTER  II 

TWO-STAGE  OPTIMAL  CONTROL  PROBUiM 

The  two-stage  optimal  control  problem  is  introduced  in  this 
chapter.  The  existence  and  characterization  of  an  optimal  pair  (con- 
trol, switching  time)  are  discussed. 

2.1.  Formulation  of  Two-Stage  Optimal  Control  Problem 

In  this  section  we  formulate  an  optimal  control  problem  with  a 
two-stage  cost  functional. 

Consider  a system  described  by  a vector  differential  equation  on 
a fixed  time  interval  T A [t^jt^] 

X = = f(x,u,t),  (1.1) 

where  x(t)  cIe'^  and  u(t)  els”'  are  the  state  and  control  vectors 
respectively,  f is  an  n-dlmensional  vector -valued  function  which  is 
assumed  to  be  continuous  in  x IE®  x T.  From  now  on,  we  denote 
"d/dt"  by  " •" . The  initial  and  final  conditions  are  given  by 

^ ^0’  ^ ^f»  (1-2) 

where  and  X^  are  nonempty  closed  sets  in 

Definition  1.1.  A control  u is  said  to  be  t^^ -admissible  for  a given 
switching  time  t^  £ T if 

1.  there  exists  a corresponding  unique  solution  of  (l.l)  which 
satisfies  (l.P), 


-J 


i ! 
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2.  u(*)  is  measurable  on  T and  u(t)  satisfies  a control 


4 


constraint 


u(t)  e 


a.e.  on  [t^.t^ 
Pg,  a.e.  on  (t^,t^] 


a-3) 


where  the  nonempty  compact  sets  i = 1,2  are  called  the  con- 
trol constraint  sets . || 


The  set  of  all  t^-admissible  controls  is  denoted  by  . A pair 
(u,t^)  is  called  an  admissible  control  pair  if  t^  e T and  u e A^.^. 
We  denote  the  set  of  all  admissible  control  pairs  by  A* 


Definition  1.2.  For  an  unspecified  switching  time  t^  £ T,  we  define 
the  two-stage  cost  functional  J(u,t^)  by 

.*f 

J(u,t^)  = J L^(x,u,t)dt  + J L2(x,u,t)dt,  (1.4) 

^0  ■^i 

where  x is  a solution  of  (l.l)  and  (1.2),  and  L^,  i = 1,2  are 
continuous  in  xIE™  x T.  || 


Now  the  two-stage  optimal  control  problem  is  defined  as  follows. 

Problem  (T);  Given  a system  (l.l),  a control  time  duration  T, 
initial  and  final  conditions  (1.2),  control  constraint  sets  and 

Jig  and  a two-stage  cost  functional  (1.4).  Find  an  admissible  control 
pair  (u  ,tj^)  which  minimizes  the  two-stage  cost  J(u,t^),  i.e., 

J(u'',t*)  <J(u,tj^),  (1.5) 

for  any  admissible  control  pair  (u,t^)  € A.  || 


8 


t 


A pair  (u  .t^)  is  called  an  optimal  control  pair  and  its  corre- 

spondinK  solution  of  (l.l)  is  called  an  optimal  trajectory  and  denoted 

■» 

by  X . A trajectory  x corresponding  to  an  admissible  control  pair 
(u,t  ) is  called  an  admissible  trajectory. 


S.2.  Existence  of  Optimal  Control  Pair 


We  give  a set  of  conditions  which  guarantee  the  existence  of  an 
optimal  control  pair  (u  ,tj^)  by  analyzing  the  properties  of  the 
attainable  set  at  time  t^,  viz,  the  set  of  all  right  hand  end-points 
of  the  admissible  trajectories  x(t)  at  t = t^. 

Consider  the  augmented  systems  described  by 


rL(x,u,t)1 

y.  = ^ f^(y..u,t), 

Lf(x,u.t)  J 


i = 1,2, 


(2.1) 


where  y^^Ct)  ^ (x^(t),x(t))  i = 1,2  will  be  referred  to  as 

augmented  states.  The  first  coordinate  x^(t)  represents  the  time 
evolution  of  the  cost 


x°(t)  = J L^{x(s),u(s),s)ds, 


(2.2) 


associated  with  the  trajectory  x specified  by  the  last  n coordin- 
ates of  y^,  i = 1,2.  We  define  augnented  attainable  sets  Kj^(t;T,E), 
i = 1,2  by 


K (t;T,E)  = U K (t;T,y), 

y«E 


(2.3) 


where 


0 


K^(t;T,y)  = ly^(t)  ; y^(t)  = y + J f j^(y^(  s)  ,u( s)  ,s)ds, 

T 

u(a)  € n^,  a.e.  on  [T,t]j,  (2.4) 

Then  the  set  of  all  end  points  at  t = t^  of  the  augjnented  trajectories 
corresponding  to  t^^ -admissible  controls,  denoted  by  K(t^),  can  be 
expressed  as 

K(ti)  = K2(t^;t^,Kj^(t^;tQ,yQ)) , (2.5) 

A T 

where  y^  = [0,Xq]  is  an  augnented  initial  point  such  that 

^0  ^ "'^0  ^ • *0  ^ ^0^’  (2*6) 

We  first  prove  the  following  theorem. 

Theorem  2.1.  Assume  that 

1.  and  are  compact; 

2.  there  exist  nonempty  sets  c]e'’  and  such  that 

for  1 = 1,2,  there  exists  a unique  solution  cp^  for  (l.l) 
with  for  any  control  u satisfying 

u(t)  e n^,  a.e.  on  T,  and  li  = fj  is  nonempty; 

3.  f is  continuous  and  ||f||^  is  bounded  by  < oo  in 

X U X T,  and  are  continuous  and  |l^(  are 

bcwnded  by  < • in  rt  x X T,  i = 1,2; 

4.  Xq  c »i  and  any  trajectory  cp  with  e Xq  correspond- 

ing to  a control  satisfying  condition  (2)  of  Definition  1.1 
for  sane  t^  e T remains  in  »i,  i.e. 

cp(t)  e rt  V t e T;  (2.?) 
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5.  the  sets  of  augnented  velocity  vectors  defined  by 


V^{x,t)  ^ : n £ n^l  , i = 1,2,  (2.8) 

are  convex  for  fixed  x and  t in  W x T. 

Then  ^{t^)  is  ccmpact  for  any  t^  e T and  varies  continuously  in 
t^  with  respect  to  the  Hausdorff  metric.^  H 

Proof:  Prom  conditions  (3)  and  (4),  for  any  solution  y^  of  (2.1) 
with  any  control  u satisfying  u(t)  € a.e.  on 
e Yq  = i(0,Xj^)  : x^  t X^J, 

t 


^ Cq  + ai(t^  - t^)  - », 


(2.9) 


where  = max^  x,- 
0 Xq^Xq  L 


and  M = max{M_,M.j.  This  implies  that 


there  exists  a ccmpact  set  c li  such  that  yj^(t)  e for  all 
t £ T.  Hence  under  the  conditions  of  this  theorem,  K^(t;tQ,XQ)  is 
"^The  Hausdorff  metric  h(A,B)  defined  on  the  space  of  ccmpact  sets  in 
is  given  by 

h(A,B)  = max'^max  d(a,B),  max  d(b,A)j, 
a£A  beB 

where  d(a,B)  is  the  distance  between  the  point  a and  the  set  B given 

d(a,P)  = min  ||a  - b(|  . 
b€B 

' is  any  valid  norm  defined  on  IC  . 

" r 


I 
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ccjmpact  for  each  t e T and  varies  continuously  in  t [ 3 ]•  Sim- 


ilarly for  any  solution  y^  of  (?.l)  with  any  control  u satisfying 

u(s)  i Pg  a.e.  on  [r.t]  and  any  yg(T)  € K^(T;tQ,XQ), 

t 

T 

< ICq  + ai(t^  - ■ V ”■ 

Therefore  Kp(t;T,Kj^(T;tQ,XQ))  is  also  ccopact  for  each  t e T,  t e T, 

T < t,  and  varies  continuously  in  t.  Hence  K(t^)  = K2(t^;t^,K^(t^;tQ,yQ)) 
is  compact  for  any  t^  e T.  Mext  we  show  the  continuity 
of  J'Ctj^)  with  respect  to  t^^.  Let  t^^  < tg,  t^  e T,  i = 1,2.  Suppose 
that  a point  is  in  K(tj^).  Then  there  exist  a point  P^  t Kj^(tj^; 

t^.y^),  a control  u^  satisfying  Uj^(t)€  fig  a.e.  on  [tj^,t^]  and  a 
corresponding  augmented  trajectory  y^^  such  that 

Pi  = = P3  + j f2(y3^(t),u3^(t),t)dt.  (2.11) 

^1 

On  the  other  hand,  since  Kj^(t;tQ,yQ)  varies  continuously  in  t, 
there  exists  a point  Pj^  € Kj^(tg;tQ,yQ)  such  that  for  every  0, 

there  exists  a b,  '•  0 

X 

|t^  . tjl  < ^ IIP3  - < Ej. 

Let  Pg  c K(tg)  = Kg(t^:tg,Kj^(tg;tQ,yQ))  he  given  hy 

.'^f 

Pg  = y2(V  = ^1*  ^ j Vy2(^)«^i(t),t)dt.  (2.12) 
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f,-  - 


Now,  vinder  the  assumptions  of  this  tlieorem,  it  is  known  that  the  solu- 
tions for  the  aujimented  system  (2.1)  depend  continuously  on  initial  condi- 
tions (7).  In  fact  we  have  for  every  p 0,  there  exists  a 5^  ^ 

such  that 


|ti  - ^2l  ^ 11^3  - ^I'n+l 

(2.13) 

uniformly  on  [t^.t^].  Hence  for  a 5^^  > 0 such  that 
we  have  for  ever\-  p ^ 0 


1^1  ■ ^2^  ' ^1  11^1  ■ ^2lln+l  ~ ^l^^f^  ■ ^2^^f^*^n+l 


This  implies  that  K^t^)  varies  continuously  in  t^  on  T. 


Next,  we  find  a subset  of  Jv(tj^)  which  corresponds  to  a set  of 
end  points  of  admissible  trajectories.  Since  the  end  point  of  any 
admissible  trajectory  must  lie  in  X^,  the  end  point  of  any  augmented 
aitnissible  trajectory  must  be  in  K(t^)  fl  for  some  t^^  o T where 


^ t'  / 0 \ _.n+l  0 „ T 

^f  '•^f  ^ 


(2.15) 


In  other  words,  any  pair  of  t^  e T and  the  end  point  y^  of  an 
au^ented  trajectory  corresponding  to  some  t^^ -admissible  control, 
(ti,yf)  € lies  in  A = G n where. 


= v'  {(t  .y)  € : y e K(t  )}, 

^ -m 


(2.1b) 


= L'  U^-i*y)  t Ik'^'^^  : y = (x^,x)  e Y^j. 
t^eT 


(2.17) 
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A is  non- 


The  set  G is  illustrated  in  Fig.  2.1.  Suppose  the  set 

empty  and  ccmpact,  then  an  optimal  control  pair  (u  ,tj^) 

* 

since  for  a ccmpact  A,  there  exists  a point  a in  A 
the  smallest  second  coordinate  value  among  all  points  in 

■K-  ^ 

first  element  of  a is  the  optimal  switching  time  t^. 

* 

control  u is  given  by  the  control  which  realizes  the  corresponding 

augmented  trajectory  y whose  end  point  y (t^)  coincides  with  the 

* 

last  n+1  elements  of  a . 

We  shall  show  the  ccmpactness  of  A = G D Z^,  hence  the  existence 

'if 

of  an  optimal  control  pair  (u  ,tj^),  in  the  following  theorem. 

Theorem  2.2.  In  addition  to  the  assumptions  (l)-(5)  of  Theorem  2.1, 
we  assume  that 


exists, 
which  has 
A.  The 
The  optimal 


the  set  of  t^^-admissible  controls  is  nonempty  for  t^ 

in  a nonempty  closed  subset  T^  cT. 


Then  A = G n Z^  is  a nonempty  compact  set  and  an  optimal  control 


pair  (u  ,tj^)  exists. 


Proof;  The  nonemptiness  of  G 0 Z^  is  guaranteed  by  assumption  (6). 
Hence  it  remains  to  show  the  ccmpactness  of  G 0 Z^.  Since  was 

assumed  to  be  closed  in  IE'^,  Z^  is  also  closed  in  Therefore 

if  G is  ccmpact  then  G fl  is  also  compact.  Obviourly  G is 
bounded;  we  only  need  to  show  the  closedness  of  G.  Let  {g^j  be  a 
sequence  of  points  of  G which  converges  to  a point  g. 
that  g € G by  contradiction. 


lU 


We  show 


Suppose  g ^ G.  Let  and  g e be  given  by 


ft  T 
, A ^11 

" [ yi  J ’ 


«My 


(2.18) 


Then  £ G and  g G implies  € K(tj^)  and  y i K(t^)  re- 
spectively, We  note  that  t^  = llm^_^oo  t^^  e T since  T is  compact. 
Now  since  K(tj^)  is  compact,  there  exists  a ball  B(y,e),  e ^ 0 in 
such  that  B(y,e)  0 K(tj^)  = 0,  where 


B(y,e)  = [y  : lly  - y|L.,  < ej. 


(2.19) 


On  the  other  hand,  since  g^  converges  to  g,  for  every  > 0, 
there  exists  such  that  j|g^  - g||jj^2  ^i’  ^ 2 ^1*  H^'^ce  for 

every  e > 0,  there  exists  such  that  [t^^^  * ^1^  ^2 


n^i  - y'Ui 


for  i Ig.  This  implies  that 


(2.20) 


d(y^,H(t^))  > -d(y^,y)  + d(y,K(t^))  > -e/2  + e = e/2.  (2.2l) 

Hence  h(  K( t . ) , K(  t, ) ) ->6/2  for  some  e > 0.  This  contradicts  the 

1 i 

continuity  of  K(t^)  with  respect  to  the  Hausdorff  metric.  Therefore 
y e K(t^),  i.e.,  g e G.  Thus  G is  compact  and  an  optimal  control 

pair  (u  ,t^)  exists.  || 


Remark:  Let  G c"  3E  be  defined  by 
s 


G^  = U l(t,,y)  £ Ie'^  : y £ K(t  )]. 


(2.22) 


t,£T 

1 s 


lb 


Then  assumption  (6)  implies 


G n = Gg  n / 0.  (2.23) 

Hence  t,  exists  in  T . || 

We  note  that  the  conditions  (l)-(6)  are  similar  to  those  of  the 

standard  existence  theorem  [ 3 ].  In  fact,  under  these  conditions, 

* 

there  exist  optimal  controls  u^,  i = 1,2  for  the  problems  with  the 
cost  functional 

f 

L^(x,u,t)dt.  (2.24) 

0 

(See  Appendix  A.) 

2.3.  Necessary  Condition  for  Optimality 

Under  a set  of  appropriate  assumptions,  a necessary  condition  for 
an  optimal  control  pair  (u  ,t^)  can  be  derived  via  direct  computa- 
tion of  first  order  variations.  The  result  is  a modification  of  a 
well-known  necessary  condition  in  calculus  of  variations  for  a standard 
problem  with  no  intermediate  switching.  A set  of  assumptions  and  con- 
ditions are  summarized  in  the  following  theorem. 

Theorem  3»1-  Consider  system  (l.l)  and  cost  (1.4).  Assume  that  the 
control  time  interval  T = ttQ,t^]  is  fixed.  Let  the  initial  point 
x(tQ)  = Xq  be  fixed  and  the  terminal  point  x(t^)  be  free.  Assume 
that  K is  continuous  everywhere  except  possibly  at  t^.  Also  assume 
that  uCt)  is  unconstrained.  Let  f,  L^  and  L^  be  twice  continuous- 
ly differentiable  in  x and  u,  and  continuously  differentiable  in  t. 
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Define  the  Hamiltonians 


Hj^(x,|j,u,t)  by 

Hj^(x,p,n,t)  = L^(x,u,t)  + p^f(x,u,t),  1 i,p,  (3,1) 

where  p(t)  Is  an  n-dlmenslonal  adjoint  vector.  We  use  the  superscript 
’■*"  to  denote  optimal  quantities.  Now,  assvme  there  exists  an  optimal 
control  pair  (u  .t^^)  where  t^  € Then  it  is  necessary  that 

there  exists  a function  p such  that  x and  p satisfy  a set  of 
canonical  equations  given  by 


.*  , * * . 
X = f(x  ,u  ,t) 


^ 

dHj^/dp  (x  ,p  ,u^,t),  t^  < t < t^\ 


^ dH^dp  (x^.p^.Ug.t) 


t^  < t < t^^ 


* * * 


P = 


-dHj^/ax  (x  ,p  ,u^,t). 


# 

-dHg/dx  (x  ,p  ,Ug,t), 


to  < t < ti  \ 


ti  < t < t^  y 


(3.2) 

(3.3) 


with  boundary  conditions 


x^(to)  = Xq,  p (t^)  = 0, 


* , * 


* . * 


(3.4) 

(3.5) 


P (t^-)  = p (t^+), 
where  p (t^^-)  and  p (tj^+)  are  the  left  and  ri^t  limits  of  p (t) 

-H-  'M' 

at  tj^  respectively  and  u^,  i = 1,2  are  solutions  of 

^ (x*(t),p*(t)  ,u*(t),t)  = 0,  ■*^0-^  *^^1^ 

^ dHg/Su  (x*(t),p*(t),u*(t),t)  =0,  t*  < t < t^ 


(3.6) 
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Also  the  following  transversality  condition  is  satisfied  at  t. 


* *v  * 


Hj^(x  (t^),p  (t^),  u^(t^),t^)  = H2(x  (t^),p  (tj^),U2(t^),t^),  (3.7) 


where  we  have  used  (3*5) 


Remarks : 

(R.l)  When  = t^,  the  boundary  condition  (3.5)  is  irrelevant  and 
the  transversality  condition  (3.7)  is  modified  to 


Similarly,  for  t^  = t^,  (3.5)  is  again  irrelevant  and  (3.7) 
is  now  replaced  by 

H^(x*(tf),0  ,u*(tp,tp  > H2(x*(tp,0,u*(tp,tp,  (3.9) 

or 

Li(x*(tp,u*(tf)  ,tf)  < L2(x*(tp,U2(tp,tp.  (3-10) 

(R.2)  The  conditions  (3.6)  and  (3.7)  are  the  two  extra  conditions  for 
our  two-stage  aproblem.  (3.6)  states  the  continuity  of  p (t) 
at  t^  and  (3.7)  states  the  matching  of  and  Hg  at  t^^.  || 

A lengthy  but  straightforward  derivation  of  the  foregoing  con- 
ditions is  given  in  Appendix  B. 


2.4.  Deccmposition  into  Standard  Problems 

We  derive  a necessary  condition  for  an  optimal  control  pair 
(u  ,tj^)  in  the  form  of  a maximum  principle  by  decanposing  the  original 
problem  into  two  standard  problems.  In  this  section,  f,  and 
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are  assumed  to  be  continuously  differentiable  in  x,  u and  t.  We 

* . 

start  our  discussion  frcm  the  case  t^^  c (tQ,t^J. 

First  we  consider  an  auxiliary  problem  which  corresponds  to  the 
second  stage  of  the  original  problem. 

Problem  1.  Given  a system  x = f(x,u,t),  a control  time  Interval 
[tj^.t^l,  initial  and  final  conditions 


x(ti)  = Xj^,  x(t^)  € X^, 

and  a control  constraint  that  u(*)  xc  measurable  on  Itj^,t^] 

u(t)  € Gg,  a.e.  on  [t^,t^]. 


i^.l) 


and 


ih.2) 


Find  an  optimal  control  u which  is  admissible  and  minimizes  the 


cost  J2(u)  given  by 


r ^ 

J2(u)  = J L2(x,u,t)dt, 


over  all  admissible  controls. 


Note;  In  this  section,  a control  u is  said  to  be  admissible  whenever 

1.  there  exists  a corresponding  solution  for  the  system  equation 
which  satisfies  the  initial  and  final  conditions, 

2.  u satisfies  a control  constraint. 

It  should  be  noted  that  the  system  equation,  initial  and  final  condi- 
tions and  control  constraint  may  vary  frcm  problem  to  problem.  || 
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t 


Problem  1 is  of  standard  form  and  can  be  solved  using  the 
Pontryagin  maximum  principle.  Let  the  Hamiltonian  be  defined  by 


H2(x,p,u,t)  = -L2(x,u,t)  + P2f(x,u,t), 


(U.4) 


where  p^  is  an  adjoint  vector.  Let  u^  and  x be  an  optimal 
control  and  its  corresponding  trajectory.  Then  there  exists  (see  the 
maximum  principle  presented  in  Appendix  C)  a corresponding  adjoint 


vector  p such  that 


) x’'  = {^Hg/apg  (x*,p*,u*,t)  X (t)  = x^,  x’'(tp  £ X^, 


(4.5) 


Pg  = - {SHg/dx  (x^,P2,u*,t)  P2('tf)  1 flf  ; 


b)  max  H2(x*(t) ,p*(t) ,U2,t)  = H2(x*(t) ,p*(t)  ,u*(t) ,t) 
a.e.  on  [t^,t^], 

where  is  a tangent  plane  to  at  x (t^) . 


(4.7) 


Now,  suppose  that  we  solve  this  problem  for  fixed  t^  and  x^^ 

* 

and  express  the  optimal  cost  as  a function  of  t^^  and  x^^,  i.e.. 


'K’  ^ 

J 2 


(4.e) 


Then  we  can  reduce  the  original  two-stage  cost  (1.4)  to  a cost  in 
standard  form  by  substituting  J^.  Thus  the  original  problem  can  be 
reformulated  as  follows; 


Problem  2.  Given  a system  x = f(x,u,t),  initial  and  final  conditions 


[(tp)  e Xq,  € (tQ,tp  and  x(tj^)  free, 


(4.H) 


t 
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and  a control  constraint  that  u(0  is  measurable  on  and 

u(t)  t a.e.  on  [tQjtj^],  (^.lO) 

where  t'^Q’^l^  danain  of  definition  of  u.  Find  an  optimal 

# 'K’  ^ 

control  u defined  on  an  optimal  interval  [t^jt^],  t^  € (t^jt^) 
which  minimizes  the  cost 

r'^  * 

J(u)  = J L^(x,u,t)dt  + J2(x(t^),tj^),  (*^.ll) 

^0 

ie.,  J(u  ) < J(u)  for  any  admissible  control  u defined  on  any 
interval  where  t^  € (t^jt^).  || 

* . 

Rfffnark ! Since  we  have  assumed  that  t^  e (tQ,t^),  the  constraint 
^ irrelevant.  Therefore  this  problem  reduces  to  a 

problem  with  free  terminal  time  and  end  point.  The  other  cases 
tj^  = t^  and  t^  = t^  will  be  treated  later.  || 

Using  the  results  in  Remark  3 of  the  maximian  principle  in  Appendix 
C,  we  have  the  following  set  of  necessary  conditions  for  an  optimal 
control  u and  an  optimal  terminal  time  t^^.  Let  the  Hamiltonian 
be  defined  as 

H^{x,p,u,t)  = -Lj^(x,u,t)  + p'^f(x,u,t) . (^.12) 

Then, 

a)  there  exists  an  adjoint  vector  p^  defined  on  [t^,!^] 
such  that 
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I 


“I 

I 


n 

I 

V 


i » 


* * * 


x"  = idH^/dp^  (x\p",u^,t)}  , X (t^)  € Xq,  (^v.13) 

= - IdH^/dx  (x*,p*,u*,t)  Pi(^0^  -i-  (^.1*+) 

^ -M- 

where  1^  is  a tangent  plane  to  at  x (t^) ; 

b)  max  H^(x*(t)  ,p*(t),u^,t)  = Hj^(x*(t)  ,p*(t)  ,u*(t)  ,t) 

ui€0^ 

a.e.  on  C’tQ.t^];  (^.15) 

^ ^ •)(- 

c)  p-(t^)  and  H I •»  satisfy  the  following  transversality 

X J.  X 

conditions. 


^ . *. 


Pi(^p  = -[^Tp'ax  (x*(t*),t*) f , 


(4.16) 


Hi(x  (t^),p^(t^),u^(t^),t^)  = (x  (t^),t^).  (4.17) 

On  the  other  hand,  by  the  help  of  additional  regularity  assxjiap- 
tions,  the  right  hand  sides  of  (4.16)  and  (4.17)  can  be  computed  as 

J2/5x^ ,tj^)  - " ^2  (^2^’  (4 ‘iS) 

?»J2/3t^(x^,t^)  = dJ^/dt^Cx^.t^)  - (aJ*/ax^(x^,tj^))dx^/dtj^ 

= H2(x’^(t^),P2(t^),U2(t^),t^).  (4.19) 

By  ccmporing  (U.lb)  to  (U.l8)  and  (4.17)  to  (4.19)  we  have 


*> 


* *.  -H  *. 

Pl(ti)  = P2(^i)» 

(4.20)  ' 

<lt*  - 4lt*' 

(4.21) 

^ ^ 

abbreviate  H^(x  ,p^,u^,t)  by  i = 1,2. 
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Thus  we  have  established  the  following  theorem. 

Theorem  U.l.  Suppose  that  (u  ,tj^),  t^^  £ (t^.t^)  Is  an  optimal 
control  pair  for  the  original  two-stage  cost  problem,  then  it  is 
necessary  that  there  exists  an  adjoint  vector  p such  that, 

^ -N- 

a)  an  optimal  trajectory  x and  p satisfy  the  set  of 
canonical  equations  given  by 


to  < t < ti  , 


(4.22) 


X (to)  e Xo  and  x (t^)  c 


to  < t < 


> ; 


j^-ldH^dx}'^,  t*  < t < t^, 

P (t^-)  = p (t^+) , 

1 ^ p*(tp  1 n* 

b)  the  Hamiltonians  1 = 1,2  eure  maximized  by  u*  as 


('+.23) 


max  H (x*(t),p*(t),u,t)  = H. (x*(t) ,p*{t) ,u*(t) ,t) , 
uen  ^ 

a.e. 


max  H (x*(t),p*(t),u,t)  = H (x*(t),p*(t),u*(t),t), 

* 

a.e. 


^5 


(4.24) 


► r 
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5 > 


I 

t 


F 

I 


c)  The  following  transversality  condition  is  satisfied  at  t^. 


"I't*  - 4it*  ■ 


('••25) 


Now,  for  the  cases  t^  = t^  and  t^^  = t^,  we  have  the  following 
result; 


Theorem  4.2.  Suppose  that  t^^  = t^  (resp.  t^^  = t^.),  then  it  is 

* 

necessary  that  there  exists  an  adjoint  vector  p such  that  for  all 
t € T, 


a)  x""  = idH^dp}"^,  (resp.  x = IdH^/dpj-^) 


(4.26) 


x*(tQ)  £ Xq  and  x*(tp  e 


P = 


• IdH^dx}^,  (resp.  p = -tdH*/Sx}^) 


*ir  ^ 

p (^0^  J-  ‘b  ^ -1-  ‘‘f 


(4.27) 


h)  u satisfies 


toax  H (x*(t),p*(t),u,t)  = Hp(x*(t),p*(t),u*(t),t) 


(resp.  max  h (x  (t),p  (t),u,t)  = tL  (x  (t),p  (t),u  (t),t)) 


(4.26) 


a.e.  on  T 


c)  at  tj^  = t^  (resp.  t^  = t^)  we 


have 


t 
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Hj^(x  (tQ),p  (t^,u^(tQ),tQ)<H2(x  (tp),?  (tp),U2(tQ),tQ) 

(resp . Hj^(x*(tp  ,p*(t^)  ,u*(tp  ,tp  > H^Cx^Ct^  ,p*(t^)  ,t^)] 


(1+.29) 


where  maximlzeB  H^, 


Proof:  We  will  consider  the  case  - ^0  other  case  % 

can  be  treated  similarly.  The  conditions  (4.26),  (4.27),  and  (4.26) 
are  derived  respectively  frctn  the  conditions  (4.23),  (4.2^),  and  (4.25) 
of  Theorem  4 .1 . Now , from  ( ^ >1^  we  have  for  t^  e T , 

,^1 

J*(\)  = J(u’^)  = I'(xtu^,  t)dt  + J2(x*(t^),t^) 

f^l 


1 tp 

= + aJ^/axI^  x''(t^)  + ajJ/atj^i^  . 


Now  using  (4.18)  and  (4.19) 


For  the  optimality  of  \ = ^ must  have 


(^.31) 


Therefore 


■”l't  “pit  -°* 


(*^.32) 


(‘*•33) 


(»*.3M 


This  gives  (4 .29) . 


L 


Remark:  Vfhen  H | and/or  H^L  <io  no't  exist  (for  example,  if  u 

is  discontinuous  at  t ),  we  replace  If  | and  H-{  by  the  left 

J.  XX*  €-  X * 

^ ^ ^ 

and  right  limits  If  | _ and  H„L  + defined  by 

1 ti  ^ t^ 


H,  L _ = 11m  HtL  p . 
^ ^1  e-0  ^ ^1'^ 

e-^0 

Hp,  + = llm  h;|  . 

^1  F-0  ^1 

e>0 


(•+.35) 


2.5.  Special  Case 

As  a special  case,  we  consider  a state  regulator  problem  with  a 
linear  system  and  a two-stage  quadratic  cost.  The  systm  and  the  cost 
are  defined  on  T = [tQ,t^]  by 


x(t)  = Ax(t)  + Bu(t) , 


(5.1) 


Xit^)  = Xq  / 0 given  and  x(t^)  free,  J 

J(u)  = J I (xCt)'’'’Qj^x(t)  + u(t)'^  R^u(t))dt 
^0 

-*•  J I (x(t)'^QpX(t)  + u(t)'^  RgU(t))dt,  (5.2) 


vdiere  A(n  x n).  B(n  x m),  ft, (n  X n),  R.^m  x m)  are  constant  matrices 

1 X 

T T 

and  ftj^  = 0»  R^  = > 0 for  i = 1,2.  We  consider  no  con- 
straint on  u(t),  i.e.,  • 

For  this  problem,  the  cost  for  the  corresponding  decomposed  prob- 
lem (l)  is  given  by 

^f 

Jg  = I |(xvt)'^ftgX(t)  + uct)"^  R2u(t))dt.  (5.3) 
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It  is  well-known  that  the  adjoint  vector  Pp(t)  and  the  optimal 
control  Up(t)  are  given  hy 


Pg(t)  = -S2(t)x  (t). 


u^lt)  = R‘Vp2(t)  = -R-Vs2(t)x'‘(t), 


(5.4) 


where  n x n matrix  Sg(t)  is  a positive  definite  solution  of  matrix 


Riccati  equation: 


^^(t)  = -Sg(t)A  - A'^S2(t)  - + Sg(t)BR'Vs2(t),l 


(5.5) 


S2(tp  = 0. 


Also  the  optimal  cost  ^le  written  as 

J^(x';t^),t^)  = I x(t^)^  S2(t^)x(t^).  (5.6) 

r»'ow,  using  (5.6),  the  cost  for  the  decomposed  problem  (2)  is  given  by, 

J = I x(t^)'^  Sg(t^)x(t^)  + J i (x(t)'^Q^x(t)  + u(t)^R^u(t))dt. 

^0 

(5.7) 

For  a free  t^^  and  free  x(t^),  problem  (2)  can  be  solved  as 
follows : 


(5.6) 


Pl(t)  = - S^(t)x*(t), 

uj[(t)  = R*Vpj_(t)  = -R"VSj^(t)x*(t), 

J 

where  Sj^(t)  is  an  n x n positive  definite  matrix  solution  of  another 


matrix  Riccati  equation: 


3" 


S^(t)  = - S^(t)A  - k\it)  - + S^(t)BR"Vs^(t), 

Si(ti)  = S^(t^). 


(5.9) 


Next  we  ccmpute  i = 1,2. 


* 1,  ♦T  * *T  T/  * 


(5.10) 


where  x^,  i = 1,2  are  solutions  of  (5.l)  with  controls  (5.8)  and 
(5.*<-)  on  [tgjt^)  and  respectively.  Algebraic  ccmputation 

using  (5.^)  and  (5.8)  yields, 

/j.  N-*-  t>  /A.  \—  f A.  \ 


“I't*  = 5 * s^(t^)x  (tj^), 


IT.  1 v T • y I 

”2lt*  = I * (^1^  S2(t^)x  (t^).  J 


(5.11) 


Hence  the  transversality  condition  L*  = H I * is 


0 = x*(t*)'^l-^(t*)  + S2{t^)  jx^Ct^) 


= X*(t*)''^  IQ^  - Qg  - S2(t*)B(R-^  - R“^)B'^S2(t*)ix''(t*).  (5.12) 

We  notice  that  if  the  matrix  Q(t)  defined  by 


Q(t)  = - ^2  - S2(t)B(R^^  - R-^)B^S2(t) 


(5.13) 


is  either  positive  or  negative  definite  for  all  t e T,  then  the 
transversality  condition  (5.12)  can  be  satisfied  only  by  x (t^^)  = 0. 

‘N’  *X* 

But  since  the  canonical  equation  for  x (t)  on  Is  given  by 

x*(t)  = (A  - BR"VSj^(t))x*(t),  (5.11+) 
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r 


then  X (t)  = 0,  if  x (t)  = 0 at  some  time.  This  contradicts  the 
condition  ^ 0.  Hence  the  definiteness  of  the  matrix  ft(t) 

gives  a criterion  for  the  nonexistence  of  an  intermediate  switching. 
This  is  summarized  in  the  next  theorem. 


M 


Theorem  ^.1.  Suppose  x^  ^ 0 and  the  matrix  Q(t)  defined  by  (5-13) 

is  positive  (resp.  negative)  definite  for  all  t e T,  then  t^  = t^ 
* 

(resp.  t^  = t^) . 


Proof:  We  already  know  that  t^  is  one  of  the  end  points  t^  or  t^. 

* 

Hence  we  only  need  to  show  that  t^  = t^  fo2-  the  positive  definite 
Q(t).  The  other  case  can  be  shown  similarly.  The  positive  definite- 
ness of  4(t)  and  ('^.1?)  gives 


*1  *1  1*,  sT'-,  s*,  V 

■^lU  " 2 ^ ^^1^  (t^)  0, 


(5.15) 


for  all  t^  e T.  Now 


let  J (t^)  = min^g.  J(u,tj^)  as  it  was  de- 


fined  in  Section  2.2.  Then  we  have 
dJ*(t^) 


dt,  " '^lU  ’ 

X XX 


(5.16) 


as  is  shown  in  Appendix  P.  Therefore  dJ  (t^)/dt^  > 0 for  all 
t^  e T.  This  gives  6^^  = Iq. 


Thus,  for  this  special  case  we  have  derived  a sufficient  condi- 
* 

tion  for  t^  to  be  one  of  the  end  points  t^  or  t^. 
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CHAPTER  III 

MULTI-STAGE  OPTIMAL  CONTROL  PROBI£M 

The  two-stage  optimal  control  problem  is  generalized  to  the 
multi-stage  optimal  control  problem  in  this  chapter.  It  is  shown  that 
the  multi-stage  problem  is  reducible  to  a standard  optimal  control 
problem  by  introducing  a set  of  auxiliary  controls. 

3.1.  Formulation  of  Multi-Stage  Optimal  Control  Problem 

We  will  now  generalize  the  two-stage  optimal  control  problem  to 
the  multi-stage  optimal  control  problem  by  allowing  the  integrand  of 
the  cost  to  switch  any  number  of  times.  The  integrand  can  switch  fran 
one  form  to  another  among  N given  forms. 

I 

As  before,  we  let  the  system,  the  control  time  interval  and  the 

I 

initial  and  final  conditions  be  given  as 

I 

X = f(x,u,t),  (1.1) 

I 

i 

I 

teT=[tQ,t^],  (1.2)  I 

I 

x(tQ)  e Xq  ciE'' , x(tp  e cIe'^.  (I.3)  ' 

j 

Let  {nj^,L^(  *,*,•)  i»  i = 1,2,...,N  be  N given  pairs  of  a control  j 

I 

constraint  set  and  cost  integrand  such  that  is  active  when  L^  j 

is  chosen  as  a current  integrand  of  the  cost  functional.  We  assume 
to  be  a convex  compact  set  in  IE°^  and,  f and  L^  to  be  con- 
tinuous in  lE*^  X D™  X 3E  , i = 1,2,...,N. 
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Definition  1.1.  We  define  a switching  schechile  to  be  a (2K-l)- 

tuple  [ t^,tp, . , . ,t^  j^:l^,ip, . . . ,i^  ] where  K is  the  number  of 

stages;  t ^ , j = 1,2,-;-. . ,K-1,  ''  ^2  " ' ^ 1 ^ ^f ' 

the  switching  times;  and  i.,  j = 1,2,...,K  are  the  indices  of  pairs 

<1 

(P,  ,L^  ) chosen  for  subintervals  [t  , ,t  ) . j = 1,2,  t = t . |j 

j j j--*-  J K 1 11 

It  should  be  noted  that,  since  the  munber  of  stages  is  free,  K 
may  vary  frcm  one  schedule  to  another. 

Definition  1.2.  A control  u is  said  to  be  .'‘>^-admlsslble  if 

1.  there  exists  a corresponding  solution  of  (l.l)  which 
satisfies  i,  1.3)  ; 

2.  u(-)  is  measurable  on  T and  u(t)  t P^^  a.e.  on 

" 1,2,...,K.  II 


The  performance  of  an  Sj^-admissible  control  u is  measured  by  a 
cost  functional  J(u)  given  by 

K 

J(u)  = i)  J L (x(t) ,u(t) ,t)dt.  (1.4) 

.1-1  t,  , 


Now  the  multi-stage  optimal  control  problem  can  be  stated  as 
follows; 


r 


t 


Problem  (M):  Given  a system  (l.l),  a control  time  interval  (1.2), 

initial  and  final  conditions  (1.3)  and  N pairs  of  control  constraint 

sets  and  cost  integrands  i = 1,2 N.  Find  a switching 

-><  * 

J and  -ailmissible  control 

u such  that 


sche.iu 


le  = [t^. 


* M 

’V-1’^1’ 
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(1.5) 


^-admissible  control  u.  || 

Such  a pair  ("'j^’^")  called  an  optimal  pair,  i.e.,  the  super- 
script denotes  optimality  as  before.  A diagram  showing  the  informa- 
tion flow  in  this  problem  is  given  in  Figure  3.1. 

The  multi-stage  problem  differs  significantly  fron  the  two-stage 
problem  in  two  ways:  (l)  the  sequence  of  integrands  of  the  cost  func- 
tional is  not  fixed,  (2)  the  number  of  switchings  is  not  fixed.  In 
particular,  we  do  not  know  beforehand  whether  the  optimal  solution  for 
the  multi-stage  problem  has  a finite  number  of  stages.  This  question 
involves  the  existence  of  an  optimal  auxiliary  control  which  will  be 
introduced  in  the  next  section.  We  will  discuss  this  point  in  later 
sections . 


for  any  switching  schedule  and  for  any 


3.2  Reduction  to  Standard  Problem 

In  this  section,  we  reduce  the  multi-stage  optimal  control  problem 
to  a standard  optimal  control  problem  using  auxiliary  controls. 

First  we  define  N auxiliary  controls  v^^,  i = 1,2,...,N  which 
satisfy  the  constraint: 


v,(t)  =0  or  1,  i = 1,2,. ..,N 
N 

D V (t)  = 1 

i=l  ^ 


a.e.  on  T.  (2.1) 


T 

We  also  define  an  auxiliary  control  vector  v = [ Vj^,V2, . . . ,Vj^]  and  an 

augmented  control  u 


33 


mi 


U-.  [“]  .rf-"  . 


(2.2) 


Let  LQ(x,u,t)  and  12  be  defined  as 


I^(x,u,t)  = 2-'  v^L^(x,u,t), 


(2.3) 


n = I I l(u  ,e  ) 6 : u.  € 12  }, 

i=l 


(2.4) 


where  e^  denotes  the  unit  vector  in  3E  with  unit  i-th  ccmponent. 

We  note  here  that  the  vector  v can  be  considered  to  represent  a 
mathematical  realization  of  the  switching  mechanism  shown  in  Fig.  3.1. 

The  constraint  (2.1)  on  v^,  i = 1,2,...,N  Implies  that  at  al- 
most every  instant  of  time  t e T,  one  of  the  v^(t)'s,  i = 1,2,...,N 
is  equal  to  one  and  all  the  others  are  zero.  Hence  at  almost  every 
t € T,  L^(x,u,t)  is  equal  to  one  of  L^(x,u,t)'s,  i = 1,2,...,N, 
depending  on  which  v^(t)'s,  i = 1,2, ...,N  is  equal  to  one.  Similarly 
the  augjnented  constraint  set  12  can  be  interpreted  as  u(t)  e 12^  when 
v^(t)  =1,  i = 1,2,...,N.  Thus  when  v^(t)  = 1,  the  integrand  of  the 

cost  is  L^(x,u,t)  and  the  constraint  set  is  12^,  i = 1,2,...,N. 

•» 

Therefore,  finding  an  optimal  auxiliary  control  v is  equivalent  to 

•» 

finding  an  optimal  switching  schedule 

Now  we  reformulate  the  reduced  multi-stage  optimal  control  prob- 
lem as  follows. 


Problem  (R);  Given  a system 


X = f(x,u,t)  = f(x,u,t)  , 
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on  a control  time  interval  (1.2)  with  initial  and  final  conditions 


(1.3)  and  a cost  functional 


J(u)  = J LQ(x,u,t)at. 


Find  an  attoissible  control  u which  minimizes  J(u),  i.e., 

J(u  ) •-  J(u)  for  any  admissible  u.  || 


Note ; Here  we  define  admissibility  of  u as  follows. 

1.  u steers  x frcxn  x(tQ)  e to  x(t^)  e X^, 

2.  u is  measurable  on  T and  u(t)  e w a.e.  on  T. 


(2.b) 


Problem  (R)  is  in  the  standard  form  and  the  Known  results  of  con- 
trol theory  are  directly  applicable.  In  particular,  standard  necessary 
conditions  are  applicable  for  the  characterization  of  u . We  will  be 
content  with  noting  that  the  maximum  principle  of  Appendix  C is  applic- 
able to  this  problem.  We  will  not  give  explicit  details  here. 

On  the  other  hand,  a difficulty  is  encountered  in  ensuring  the 
existence  of  u , due  to  the  fact  that  the  augmented  constraint  set 
is  never  convex.  Hence  we  may  experience  a situation  where  the 
optimal  control  is  a "chattering"  control.  This  will  be  discussed  in 
detail  in  the  following  section.  Furthermore,  frcm  an  engineering 
point  of  view,  it  is  not  feasible  to  have  an  infinite  number  of 

-It- 

switchings.  That  is  to  say,  v should  have  only  a finite  number  of 

■» 

discontinuities.  We  demand  a piecewise  continuous  v rather  than  a 

■tt 

measurable  v . There  have  been  several  papers  on  the  existence  of 
optimal  piecewise  continuous  controls  e.g.  HajJtin  [21],  Halkin  and 


Hendricks  [22],  and  Cirlmmell  [19].  However  these  works  treated  only 


p 


p 


> 


f 


H 


dydtems  which  were  either  linear,  or  linear  in  the  state  variable. 

The  existence  of  optimal  piecewise  contimious  controls  for  more  general 
systems  is  still  an  open  question  and  remains  a subject  for  ilirther 
research . 


1.3  Chattering  Control 

For  the  existence  of  optimal  measurable  controls,  most  of  the 
standard  existence  theorms  require  a set  of  augmented  velocity 
vectors 


V(  x,t)  = I ' ® m : y^  = L(x,u,t),  y=f(x,u,t),  u e r|. 


3.1) 


or  a set  V^(x,t)  defined  by 


v''(x,t)  = { _ yj  ^ : Yq  L(x,u,t),  y = f(x,u,t),  u e ii  j-  , 


(3.2) 


to  be  convex  for  each  x and  t (see  Appendix  A).  This  almost  ex- 
clusively requires  the  control  constraint  set  C to  be  convex.  In 

general,  for  problems  which  satisfy  all  except  the  convexity  condition 

* 

for  the  existence  of  u , an  optimal  control  may  not  exist  bvit  the 
optimal  "relaxed"  control  may  exist  for  the  corresponding  "relaxed" 
problem.  Warga  [42]  gives  an  extensive  discussion  on  the  relaxed 
problem  and  Berkovitz  [ 3 1 has  a concise  presentation.  Roughly  speak- 
ing, the  idea  of  the  relaxed  problem  is  that,  by  allowing  the  velocity 
vector  x(t)  to  take  on  any  value  in  the  convex  hull  of  V(x,t),  the 
existence  of  an  optimal  relaxed  control  and  a corresponding  relaxed 
trajectory  is  assured.  In  such  cases,  it  is  known  that  ( Warga  [42  ], 
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Gamkrelitze  [1?  1)  under  appropriate  assumptions,  solutions  of  the 

relaxed  problem  can  be  uniformly  approximated  by  solutions  of  the 

original  problem.  It  is  also  known  (for  example,  Berkovitz  [ 31)  that 

such  approximations  can  be  realized  by  "chattering"  controls  u , 

ch 

where  jumps  rapidly  back  and  forth  among  various  points  of  G. 

We  present  a proposition  which  states  conditions  under  which  relaxed 
solutions  can  be  uniformly  approximated  by  ordinary  solutions. 

Proposition  3.1  [ 3 ]•  Consider  a control  system  defined  on  T = [a,b], 
X = f(x,u,t),  where  f is  continuous  in  X lE^  X IE.  Let  fi  be  a 
control  constraint  set.  suppose  that  (}>  is  a relaxed  trajectory  sat- 
isfying 

cj‘(t)  CO  f{<P(t)  ,n,t) , a.e.  on  T,  (3-3) 


where  Co  E denotes  the  convex  hull  of  a set  E.  Assume  there  exists  an 
integrable  function  p defined  on  T such  that 

!|f(x,u,t)|l^  < a(t),  (3.4) 

and 

||f(x,u,t)  - f(y,u,t)||^  < p(t)!!x  - y!!^  (3.5) 

for  all  u £ f,  t £ T.  Then  for  any  e > 0,  there  exists  an  ordinary 
trajectory'  satisfying 

\if(t)  = f(\tr(t),u(t),t),  (3.6) 


corresponding  to  an  ordinary  control  u(t)  e 0 a.e.  on  T such  that 


T(t)  - \)^(t)!i^  < E. 


(3.7) 


3t' 


T 

N 


I 


1 


I 

i 

I 


i 
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Returning  to  our  problem,  fi  given  by  (2.1+)  is  canpact  if 
i = 1,2,..,,N  are  compaet  but  never  convex.  Renee,  in  general,  we 
may  onlj-  assionc  the  existence  of  relaxed  solutions  for  the  correspond- 
ing relaxed  problem  and  we  may  have  to  adopt  a chattering  control  as 
an  approximation  to  an  optimal  control. 

We  conclude  this  chapter  by  presenting  the  following  example. 
There  exists  no  optimal  control  for  this  example  but  the  value  of  the 
cost  can  be  made  as  close  to  its  lower  bound  as  desired  by  chattering 
controls.  Wo  note  that  if  the  example  is  formulated  as  a two-stage 

■k  ■»( . 

problem,  then  there  exists  an  optimal  control  pair  (u  ,t^) . This  is 
also  demonstrated  in  the  example . 


Example . Consider  a multi-stage  optimal  control  problem  oti  T = [0,l] 


with  the  system  equation  and  terminal  conditions  given  by 


X = u. 


x(0)  = 0,  x(l)  free. 


(3.0 


(3.9) 


and  with  a cost  functional 


i 

J(u,v)  = J [ -i  (x^  + (u  - !)'’■]  4 ;x^  + (u  + l)^}jdt. 


(3.10) 


We  ass\ime  that  = [-2,2],  The  augmented  velocity  set  V^x,t) 

and  the  sot  V^\,x,t)  are  shown  in  Fig.  3.2.  Obviously  neither  set  is 
convex.  On  the  other  hand,  this  example  satisfies  all  the  conditions 
of  Proposition  3.1.  Therefore  the  optimal  control  may  not  exist  but 
the  optimal  relaxed  control  may  exist.  In  that  case  the  optimal 
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relaxed  trajectory  can  be  uniformly  approximated  by  a trajectory 

corresponding  to  some  chattering  control.  In  fact,  we  can  find  a 

sequence  of  controls  which  do  not  converge  to  any  functions  in  the 

usual  sense  but  the  sequence  of  the  corresponding  costs  converges  to 

the  obvious  lower  limit  of  j(u,v),  namely,  zero. 

Note  that  J(u,v)  can  be  zero  only  when  (l)  x(t)  = 0,  u(t)  = 1, 

v^(t)  =1  and  v^Ct)  = 0,  or  (2)  x(t)  = 0,  u(t)  = -1,  v^(t)  = 0 and 

v^Ct)  = 1.  But  from  (3*f)»  this  cannot  be  realized.  Instead,  we  con- 

k k. 

sider  the  following  sequence  of  controls  (u  ,v  ) : 


1 on  [2i/2^,  (2i+l)/2^] 

u (t)  =1  , , , i = 0,1, ...,2^-1,  , 

(-1  on  [(2i+l)/2^,  2(i+l)/2^] 

(3.11) 


V^t) 


[1,0]'^  when  u^(t)  = 1 

[0,1]'^  when  u^(t)  = -1 


(3.12) 


These  controls  are  shown  in  Fig.  3.3  together  with  their  corresponding 
trajectories.  Obviously  these  controls  satisfy  the  control  constraints. 

Fran  Fig.  3.3»  if  is  clear  that 

1/2^ 

J(u^,v^)  = 2^  i t^/2  dt  = (3  X 2^’^^^)'^.  (3.13) 

0 

k k \ k k 

Hence  J(u  ,v  ) -•  0 as  k -♦  *.  But  clearly  as  k (u  ,v  ) has 

no  limit  in  the  usual  sense.  Thus,  despite  the  fact  that  there  is  no 

optimal  control,  J(u,v)  can  be  made  as  close  to  its  lower  limit  zero 

as  desired  by  letting  the  control  "chatter"  rapidly  enough. 

Now,  suppose  that  this  example  was  formulated  as  a two-stage 

problem  rather  than  a multi-stage  problem.  In  other  words,  we  assume 


^ I 


UO 


that  the  cost  is  given  as 


ti  1 

J(u,t^)  = J i + (u  - l)^idt  + J I (x^  + (u  + l)^}dt 
0 

{3.1^) 


Then  the  Hamiltonians  and  are  defined  by 


X 2 2 

H^(x,p,u)  = - [x  + (u  - 1)  } + pu 


H^Cx.Pju)  = - I {x^  + (u  + l)^j  + pu 


The  optimal  controls  for  each  stage  are 


•K 

max  H^(x,p,u)  u (t)  = p (t)  + 1 
u 

majc  H^CxjPju)  =>  u (t)  = p (t)  - 1 
u 

Substituting  (3.16)  into  (3.15)  leads  to 


* 1 , *2  *2  ^ * 

Hi  = - I (x  ^ - p ) + p 

* 1 , *2  *2  \ 

H2=-i(x‘'-p^)-P 


Now,  the  canonical  equations  for  each  stage  are 

* 


d rX  -1  rO  1-1  rX  -1  r 

dt  ^ '^l  0^  '■p*^  *-0^ 

-K-  *X' 

ci  rX  -I  rO  It  fX  -1  C“l'i 

It  'p*'  " '1  o'  '»•'  ' o' 


This  gives 


‘p*(t)'  ' 


r,  * 


(Pq+1)  sinh  t 

5^ 


(p*+l)  cosh  t 


x^  cosh(t-l)  - sinh(t-l) 
i_x*  sinh(t-l)  - cosh(t-l)  + 1 


4l 


(3.15) 


(3.16) 


(3.17) 


(3.18) 


(3.19) 


’ I 


; ( 


•*A*,  \ *A*\  * 

where  Pq  = p (0)  and  = x (1),  and  we  have  used  x (0)  = 0 and 

p (l)  = 0.  Using  the  transversality  condition  H*)(t*-)  = l{2l(t*+), 

we  have, 


P (tj^)  = 0. 


(3.20) 


^ 'M' 

Fran  (3.19)  and  (3*20),  t^»  x^  and  p^  can  be  computed 

[tt  1 r 1/3  1 fl 


-tanh  1/3 


, or  tanh  1 


(3.21) 


(cosh  1/3)"^  - 1 I [(cosh  1)"^  - 1 


These  two  extremal  cases  are  shown  in  Pig.  3.U.  The  corresponding  cost 
values  are  respectively  0.02  and  0.12.  Thus,  an  optimal  control  pair 
(u  ,t^)  is  given  by 


t 

= 1/3, 


(3.22) 


^ (co3ht)/(cosh  1/3),  0 < t < 1/3 

U (t)  = . (3.23) 

-(cosh(t-2/3))/(coBhl/3),  I/3  t ^ 1 


We  note  that  u (t)  satisfies  the  control  constraint.  The  correspond- 


ing  trajectories  x (t)  and  p (t)  are 


x*(t) 


I ( sinht)/(coshl/3),  0 < t v 1/3 

l-(sinh(t-3/2))/(coEhl/3),  I/3  ^ t ^ 1 


, (3. 24) 


P*(t) 


u (t)  - 1, 
u*(t)  + 1, 


0 < t < 1/3 
1/3  ^ t ..  1 


(3.25) 


This  concludes  the  example. 
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CHAPTER  IV 

FIXED  k-STAGE  OPTIMAL  CONTROL  PROBLEM 

In  this  chapter,  we  give  a necessary  condition  for  an  optimal 
control  problem  with  a cost  assuming  k different  forms  on  k fixed 
stages,  the  control  being  kept  constant  on  each  stage. 

4.1 . Formulation  of  Fixed  k-stage  Optimal  Control  Problem 

As  will  be  discussed  in  Chapter  V,  in  the  plasma  heating  prob- 
lem, it  is  desired  to  find  an  optimal  piecewise  constant  neutral  in- 

jection  heating  program  I such  that,  (1)  I (t)  is  kept  constant  on 

/ \ * 

each  given  subinterval,  and  (2)  I minimizes  the  given  cost  func- 
tional which  may  assume  different  forms  on  different  subinbervals . 

This  motivates  the  fixed  k-stage  optimal  control  problem  which  will  be 
(Jiscussed  in  this  chapter. 

First  we  consider  a system 

X = f(x,u),  (1.1) 

given  on  T = [tp,t^],  where  f is  continuously  differentiable  in 
IE”  X IE®.  With  the  application  to  the  plasma  heating  problem  in  mind, 
we  consider  the  following  terminal  conditions. 


x(to)  = Xq, 

(1.2) 

h(x(t^))  < 0, 

(1.3) 

where  x^  is  given  and  h is  a continuously  differentiable  function 
of  x(tp.  Let  ,L^(  • , •)} , i =l,2,...,k  be  k given  pairs  of 


! 

< 
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control  constraint  sets  and  integrands  of  the  cost.  We  assume  that 


n.  i are  nonempty  convex  coopact  sets  and  the  are  con- 

tinuously differentiable  in  XE®.  Then  the  fixed  k-stage  cost 


is  defined  as 


k ,^i 

J(u)  = T.  L (x(t),u(t))dt 

Vi 


(l.M 


where 


t^,  i = l,2,...,k-l  are  given  switching  times  and  tj^  = t^. 


Definition  1.1.  A control  u is  said  to  be  admissible  if 

1.  there  exists  a corresponding  solution  of  (1.1)  which  sat- 
isfies the  terminal  conditions  (1.2)  and  (l.3)> 

2.  u(t)  is  constant  and  u(t)  = e on  each  jt^) , 

i = l,2,...,k-l,  and  u(t)  = \ ^ \ II 


Now  the  fixed  k-stage  optimal  control  problem  is  stated  as 


follows : 


Problem  (F):  Given  system  (l.l),  terminal  conditions  (1.2)  and  (I.3) 
and  k pairs  of  constraint  sets  and  integrands  of  the  cost  functional 
[s1^,Li},  i = l,2,...,k,  find  an  admissible  piecewise  constant  control 
u which  minimizes  the  cost  (1.4),  i.e.,  J(u  ) < J(u)  for  any 
admissible  u.  || 

Without  loss  of  generality,  we  consider  the  case  u(t)€E^  only. 
Also  we  assume  that  the  constraint  sets  are  compact  intervals,  i.e., 


(1.5) 


where  -»  < < w^  < «>,  i = The  results  obtained  in  the 

following  sections  can  be  easily  extended  to  the  case  with  m-dimen- 
sional  controls . 


4.2.  Reformulation  as  Parameter  Optimization  Problem 

For  the  fixed  k-stage  optimal  control  problem,  it  is  required 
that  the  control  function  is  constant  on  each  fixed  subinterval. 
Since  there  are  k fixed  subintervals,  the  control  function  can  be 
written  as 


u(t) 


k-1 

= E 
i=a 


^^[t,.i,ti) 


u,  X 

k 


(2.1) 


where  is  the  characteristic  function  of  a set  E.  By  considering 

(2.1)  as  a map  3 from  to  the  cleiss  of  control  functions  under 

consideration,  we  can  identify  the  control  functions  with  vectors  in  lE^. 
Therefore  we  can  formulate  the  fixed  k-stage  optimal  control  problem 
as  a parameter  optimization  problem  in  ]E^ . 

Let  u denote  the  parameter  vector  [u^  jU^j  • • • >Uj^  € lE^  . Then 
the  constraint  on  the  control  function 


j Ui  € fli  = [Vi,Wi  ] on  [t^_^,t^),  i = l,2,...,k-l, 

u(t)  = 


(2.2) 


is  equivalent  to 

gi(u)  = (u^- v^)(u^-w^)  <0,  i = l,2,...,k.  (2.3) 

Next,  the  final  condition  (1*3)  can  be  transcribed  as  a con- 
straint on  the  parameter  vector  u by  considering  a map  from  u to 
x(t^)  such  that 


Xk(li)  = x(t„) 


(2.4) 


where  x(tp  is  the  final  point  of  the  trajectory  x corresponding 
to  the  control  function  5(ji).  Substituting  (2.4)  into  (1 .3)  yields 


h(xj^(u))<  0. 


(2.5) 


Now  the  fixed  k- stage  optimal  control  problem  is  reformulated  as 
a parameter  optimization  problem. 


Problem  (P)*  Minimize  the  cost  J(u)  given  by 

k p^i 

J(u)  = ^ J L^(x(t),u^)dt, 
1-1  *1-1 


(2.6) 


with  respect  to  u = [u^jUg, . . . ,Uj^  ] subject  to  (2.3)  and  (2.5),  idiere 
x(t)  is  a solution  trajectory  of  (l.l)  with  (1.2)  and  a control 
function  3(u^ . || 

Thus  we  have  a standard  nonlinear  programming  problem  for  which 
the  standard  results  of  nonlinear  programming  are  readily  applicable . 

4 .3 . Necessary  Condition  for  Optimal  Parameter  Vector 

In  this  section,  we  present  a set  of  necessary  conditions  for  an 
optimal  parameter  vector  by  applying  the  Kuhn-Tucker  (K-T)  condition 
to  the  reformulated  parameter  optimization  problem.  The  K-T  condi- 
tion in  general  form  is  given  in  Appendix  D. 

First  we  define  the  Lagrangians  J(u)  and  M(u)  as 


J(li)  = XqJ(u)  + nli(Xj^(u)), 
A ~ ^ 

M(u3  = j(u)  + 7)  \g,(u)> 


(3.1) 

(3.2) 


t 


where  i = and  M-  are  scalar  multipliers.  Let  u 

be  an  optimal  parameter  vector.  Then  the  K-T  condition  states  that 
* 

at  u = u 


+ S = 0. 


(3.3) 


As  we  have  discussed  in  Chapter  1,  no  assumption  will  be  introduced  in 
deriving  the  gradients  in  (3.3) • 

The  following  theorem  gives  necessary  conditions  in  integral 
form.  We  note  that  the  gradient  v^M  can  be  written  in  a compact 
form  by  introducing  the  adjoint  vector  p(t)  and  the  Hamiltonians 
>p('t) ^u^ Aq) > i = l»2>...,k. 

-if  T 

Thecrem  3.1.  Suppose  a vector  u = [u^jUg^ . • • ] is  optimal, 
then  it  is  necessary  that 


ph)  =-f9H^/Bx  (x*(t),p*(t),u*,A*)}'^ 
(t^_j^,tj^),  i = l,2,...,k, 


on 


P - P (t^+),  i — l,2,...,k“l, 

,P*(tp 


> 


(3.^) 


where  x (t)  seitisfies 


r 


• ■X*.  . . . * - . “X*  - M:  _ *v  ■\T 

X (t)  = {SH^/ap(x  (t),p  (t),u^,Ap)}^ 

^ on  ^ ~ 1,2, ...jk, 

X ^ i = l>2,...,k-l, 

^x*(to)  = Xq,  h(x*(t^))  < 0, 


(3.5) 


and 
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(3.6) 


H^(x  (t),p  (t),u^,AQ)=Xp]!,^(3t  (t),u^)  + p (t)  f(x  (t),Uj,), 

i — 

* 

2.  there  exist  scalar  nonpesitive  multipliers  < 0, 
i = l,2,...,k  such  that 


* , * 


^i®i^~  i-l,2,...,k; 


(3.7) 


* 


*,  * — 


V^_^M(u  ) = 


r ('t)>P  (t) /U^ ,AQ)dt  + 2A^(u^  - u^) 

*0 

J*  (^)>P  (t)  + 2A2(u2  - U2) 

\ 


“k-l 


= 0 


(3.8) 


where  = (v^  + w^)/2,  i = l,2,...,k. 


For  the  proof  of  this  theorem,  we  refer  to  Appendix  F. 


Remarks ; 

(R.1)  M.*  in  (3.4)  is  a norpositive  multiplier  corresponding  to 

* * . 
the  condition  h(xj^(u  ))  < 0.  Moreover,  [.:  < 0 if 

h(xj^(u*))  = 0 and  |x*  = 0 if  h(Xj^(u  ))  < 0. 

(R.2)  The  multiplier  in  (3.6)  is  nonpositive.  We  can  assume 

A*  < 0 if  the  first-order  constraint  qualification  is 
satisfied  (various  types  of  constraint  qualifications  are 
discussed  in  Margasarian  [3I]  ) . But  when  the  constraint  is 
of  the  implicit  type  such  as  (2.5),  it  is  generally  imposs- 
ible to  check  the  qualification  a priori.  || 
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The  followixjg  theorem  gives  a more  explicit  characterization  of 

* 

u . It  is  said  that  the  constraint  is  active  if  gj(u)  <0  is 

satisfied  by  equality. 

Theorem  3.2.  Let  u = [uj^,Ug,  ] be  optimal.  Suppose 

(9H./3U  )(t)dt  / 0,  then  g.  is  active  arxJ 

^i-1 


V^,  if  r ^ (aH*/au^)(t)dt  < 0 
= t 

Wj,  if  [ ^ (9H*/au^)(t)dt  > 0 

'*i-l 

where  (aH*/au^)(t)  = (BH^/Su^)(x*(t),p*(t),u*,:N*) . |( 


(3-9) 


Remark : When  = 0 , it  is  obvious  that 


9^^/au  (t)dt  = 0. 
^i-1  ^ ^ 


(3.10) 


For  this  case  may  take  any  value  in  [v^,w^]  and  the  equality 
(3.10)  must  be  solved  to  find  u*.  || 


Proof  of  Theorem  3.2.  Suppose 


t; 

(aHj/au^)(t)dt  > 0. 


(3.11) 


Then  in  order  for  (3.8)  to  be  satisfied,  we  must  have 


*.  * — 


\(>ii  - Uj^)  < 0. 


(3.12) 


This  implies  ^ 0 and,  from  the  nonpositiveness  of  7\^,  < 0. 

Now,  for  < 0,  the  condition  (3.7)  states  that  is  active,  i.e. 
^^(ii  ) = 0.  Hence  either  u^  = v^  or  u^  ""  ''i  • again  for  A^<0, 
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(3.12)  can  be  satisfied  only  if  > 0.  Therefore  ^ ^±' 

The  other  case  can  be  shown  similarly . 

In  general,  some  iterative  procedure  must  be  employed  for  the 
computation  of  u since  the  conditions  in  the  above  theorems  in- 
volve  u . For  the  computational  aspects  of  the  nonlinear  programming, 
we  refer  to  standard  texts  (for  example,  Canon,  Cullum  and  Polak  [ 6 ]) . 
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CHAPTER  V 


PIASMA  HEATING  BY  NEUTRAL  INJECTION 


A problem  of  minimum  input  energy  plasma  heating  by  neutral  in- 
jection is  presented  in  this  chapter.  The  problem  is  formulated  as  a 
two-stage  optimal  control  problem  and  is  solved  utilizing  the  results 
of  Chapter  II.  An  optimal  piecewise  constant  neutral  injection  pro- 
gram is  then  derived  using  the  techniques  discussed  in  Chapter  IV. 


^.1.  Minimum  Input  Energy  Plasma  Heating  Problem 


In  a recent  report  [9],  the  problem  of  toroidal  plasma  heating 
by  neutral  injection  was  studied  using  a spatially-averaged  two- 
temperature  model  of  the  plasma.  It  was  shown  that  the  problem  of 
minimizing  the  total  input  energy  while  achieving  a desired  ion  tem- 
perature gives  rise  to  a two-stage  optimal  control  problem.  We  will 
give  an  explicit  formulation  of  this  problem  in  this  section. 

When  the  electron  and  ion  temperatures  T^  and  T^  are  of  the 
order  of  KeV,  we  have  the  following  equations  for  the  average 
energy  transport  associated  with  the  electrons  and  ions. 


dT 

4 = S-  - S , - S„  + sf,, 

2 dt  J De  ei  R N’ 


2,  - Q O O . o'** 

2 dt  ' ei  ■ ^Di  ' ^ex  ’ 


(1.1a) 


(l.lb) 


where  S^.  respectively  the  energ.v 

transport  terms  corresponding  to  Joule  heating,  electron-ion  energy 
exchange,  diffusion  loss  of  species  j (j  = e and  i for  electrons 


r ^ 


■! 


and  ions),  line  radiation  loss,  excitation  and  power-transfer  frcm 
neutral  beam  to  species  j.  In  explicit  form,  (l.l)  can  be  expressed 
as 

dT. 


1 _ -r-3/2/.n 


■3/2^ 


(l.a) 

(1.2c) 

(1.2d) 


where  is  the  toroidal  plasma  current,  E and  I are  the  average 

particle  kinetic-energy  and  current  of  the  injected  neutral  beam,  and 
and  are  normalized  injected  power  transferred  to  electrons 

and  ions  respectively.  The  average  particle  kinetic-energy  E is 
assumed  to  be  fixed.  The  exponents  a and  P depend  on  the  electron 
diffusion  regime.  Here  we  set  a = l'2  and  p = 0 which  correspond 
to  the  collisional  regime.  The  ion  diffusion  in  the  three  regimes  is 
approximated  by  the  function  defined  by 

where  Int [a^ja^jS^ } denotes  the  intermediate  value  of  the  three 
quantities  a^,  i = 1,2,3.  The  coefficients  and  are 

given  in  Appendix  F.  For  a detailed  discussion  of  this  two-tempera- 
ture model,  we  refer  to  [ 9]« 

As  was  discussed  in  Chapter  I,  we  consider  a heating  program 
beginning  with  an  initial  Joule  heating  period  followed  by  conbined 
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neutral  injection  and  Joule  heating. 

Let  the  heating  interval  [0,t^]  be  fixed.  For  a neutral  in- 
jection current  l(t)  defined  on  with  t^^  € [0,t^],  the 

total  input  energy  into  the  plasma  is  given  by 

t t 

r f ? -./p  f 

J(I,t^)  = j A^lV^^''(t)dt  + J REI(t)dt,  (1.4) 


where  the  integrands  of  the  first  and  second  integrals  correspond  to 
Joule  heating  and  neutral  injection  heating  respectively,  and  the  con- 
stant R is  given  in  Appendix  F. 


Minimum  Energy  Plasma  Heating  Problem;  Given  the  two-temperature 
model  of  the  plasma  described  by  '1.2);  a finite  heating  time  interval 
T = [0,t„];  initial  conditions 


(T^(0),T^f0),X^(0),Xg(0))  = (T^q,T^q,0,0); 


(1.5) 


a desired  ion  temperature  and  a constraint  on  the  injec- 

tion current  I(t)  of  the  form 


jl(t)  = 


[0,t^),  j 


|l(t)  ^ -2  = fImin’W] 


(1.6) 


where  > 0,  > 0,  > 0 and  are  specified 


max  min 


finite  constants,  find  a neutral  injection  program  (I  ,t^)  such  that 
Ti(tf)  _ and  the  total  input  energy  J(I,t^)  given  by  (1.4)  is 

minimized.  || 
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Note  that  in  this  problem  formulation,  E is  held  constant.  In 


general,  both  E and  I can  be  considered  as  controls. 


We  rewrite  the  total  cost  J in  the  following  form. 


•*1  i 

r(l,t^)  = J A^lV3^^(t)dt  + j lA^lV3^^(t)  + REI(t)}dt. 


(1.7) 


Thus,  the  minimum  input  energy  plasma  heating  problem  is  formulated 


as  a two-stage  optimal  control  problem  for  which  the  results  of 


Chapter  II  are  readily  applicable. 


5 . 2.  Existence  of  an  Optimal  Heating  Program 


We  shall  show  that  the  plasma  heating  problem  satisfies  all  the 


-TT  'K' 

conditions  for  the  existence  of  an  optimal  control  pair  (u  ,t^) 


given  in  Theorems  II. 2.1  and  II. 2. 2 . 


Let  X denote  the  system  state  vector  [T^,T^,X^,X2]  t]E  . 
Let  the  right  hand  side  of  the  system  equation  ( 1.2a) -( 1.2b)  be  de- 


noted by  f(x,l)  = 


The  initial  set  X^  and  the  constraint  sets  and  are 


given  by 


'‘o  ' • L ■ '“)■  ”2  • (2.1) 


Hence  the  conpactness  condition  (l)  in  Theorem  II. 2.1  is  satisfied. 


The  convexity  condition  (5)  in  the  same  theorem  is  also  satisfied 


since  the  augmented  velocity  vectors  (A^I^^^'  ^,f(x,l))  and 
,AilV  ^^^+Rj;i,f(x,l))  are  affine  in  the  control  I,  is  a point 


and  ftg  is  convex.  Note  that  Theorem  II. 2.1  is  still  valid  when  the 


set  of  augjnented  velocity  vectors  is  reduced  to  a point. 
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We  note  that  the  two-temperature  model  (1.2)  of  the  plasma  is 

U 

defined  only  in  a cone  C e IE  given  by 

f = ; 0 Tg,0  < T^,0  < X^,0  < X^}.  (2.2) 

Let  i.  be  a nonempty  canpact  subset  of  C.  Then  f(x,l)  and  the 
integrands  of  the  cost  functional  (1.4)  are  uniformly  continuous  in 
Jb»  ^ U ^2^  ^ This  shows  that  the  continuity  and  boundedness  con- 
dition (3)  of  Theorem  II. 2.1  is  satisfied  on  jB  x U ^2^  ^ 
any  canpact  set  j6  c C. 

Now  the  measurability  of  the  control  l(*)  and  the  boundedness 
of  ffXjl)  implies  that  F(x,t)  = f(x,I(t))  satisfies  the 
Caratheodory  hypothesis  [ 7 ].  Furthermore,  F(x,t)  satisfies  the 
Lipschitz  condition 

llF(x,t)  - F(y,t)|,^  - ylln»  (2-3) 

for  any  x and  y in  any  canpact  set  c C and  any  fixed  t e T, 
because  the  Jacobian  matrix  fdF(x,t)/dx)  exists  for  almost  all  x e C 
for  fixed  t e T,  and  each  element  (dP/dx)..,  i,j  = 1,2, 3, 4 is  uni- 
formly  bcfunded  in  any  c i.e.,  for  any  x € and  t £ T, 

I (dF(x,t)/dx)^^|  cc,  i,j  = 1,2, 3, 4,  (2.4) 

whenever  (dF(x,t)/dx)  exists.  Thus  we  can  apply  Theorem  2.2  in 

ij 

1.  Chapter  2 of  [ 7 ] to  establish  the  existence  of  a unique  solution  of 

I 1.2)  passing  through  any  point  of  &■  with  any  control  satisfying 

the  control  constraint.  Consequently,  condition  (2)  of  Theorem  II. 2.1 
of  the  existence  of  a unique  solution  is  satisfied. 
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Next  we  shall  prove  the  following  theorem,  which  shows  that 
condition  of  Theorem  II.?.l  is  satisfied. 


Theorem  2,1.  There  exists  a canpact  set  S c C such  that  (l)  the 

T 

given  initial  point  x^^  = [T^q,T^q,0,0]  is  in  and  (2)  for  any 

control  I which  satisfies  the  control  constraint  (1.6),  the  corre- 
sponding trajectory  does  not  escape  from  .5.  || 


For  the  proof  of  this  theorem,  we  need  the  following  result. 


Lemma  2.1.  Consider  a function  g defined  on  {0,<»)  such  that 


, , ,.2  -3/2  „ 1/2  „ -1/2  , 
g(r)  = A^I^r  - k^r  ' ~ kj  - k^  - e. 


(2.5) 


2 2 

where  e > 0 is  a constant.  Assi-me  that  A^  - 12A^A2lp  ^ 0.  Then 
g(r)  is  strictly  monotone  decreasing  and  g(r)  = 0 has  a unique 
solution  in  (O,^).  || 


Proof:  Since  g(r)  is  continuous  in  (0,<»)  and 


lim  g(r)  = 00,  lim  g(r)  = -~, 
r -*0  r -*00 


(2.6) 


there  exists  at  least  one  solution  for  g(r)  = 0.  On  the  other  hand. 


dg/dr  = -r‘5/2(A2r^  - A^r  + 3k^^)f?.. 


(2.7) 


Since  the  discriminant  D of  the  parenthesized  quadratic  form  is 


negative  by  assumption,  we  have 


(dg/dr)  0,  V r > 0. 


(2.8) 
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Thus  g(r)  is  strictly  monotone  decreasing  and  there  exists  a unique 
solution  for  g(r)  = 0 in  (0,»).  11 


Note  that  for  the  actual  parameter  values  (see  Appendix  G) , 
D ® -9.  Hence  the  condition  in  licmma  2.1  is  satisfied. 

Now  we  proceed  to  prove  Theorem  2.1. 


e — emin 


(2.9) 


Proof  of  Theorem  2.1;  Let  T^^  be  the  unique  solution  of  g(r)  = 0. 

'^emin  “ ‘"^”^'^ec’'^e0-^"  Hereafter,  we  assume  that  T_  • T.  . _ . 
For  any  I e or  1 = 0,  we  have 

Lijc^.o ' - »• 

Let  ^max  given  by 

Then  for  any  I satisfying  the  constraint. 


(2.10) 


‘^'^rtmax 


= T'^^^EI  - (C^T‘3/2  ^ CpE‘3/^)X 


Imax 


<•  T"^{^  El  - C E"^'^^{1  + (T’^^^I  )/(C  I 

- emin  max  ??  ^ ^ emin  max^/^^?'^  ) •> 

(2.11) 


= < 0. 


Next  we  consider  f For  any  I e [I  . ,I  ] or  1=0 
2 min  max  ’ 


Define  as 

anax 


‘'slx^.o  • i 0- 


^anax  = - ■"  ^^max^^2' 


(2.12) 


(2.13) 


bO 


Then  again  for  any  I £ [I  or  1=0, 

min  max 


■2'X^=X^ 

2 anax 


anax 


< E"^^^(EI  ) - C-E‘^'^^(l  + El  /Cj 

- ' max'  2 ^ max'  2' 

= <■  0. 


(2.14) 


Rirthermore,  for  e [0,X^^^] , 

-1/2 


'■iIt.-O-  Ve*'“* 
1 


(2.15) 


We  also  have  for  X^^  e 


f I _ A '' 

^i'T.=T.  3 e 

1 imax 


Ve  '^ixnax-  ^Di^^imax'^p)  W V2 


n-3/2 


- B,  T.  + =0,  (2.16) 

3 emin  4 imax  > Snax 


where  T.  is  given  by 

imax 


T.  = (A„T”^(^  + B-X.  )/B, 
imax  3 emin  y anax"  4 


(2.17) 


Now  we  compute  ^glip  -T  ' Lemma  2.1, 

e”  emin 

felT  .T  , - 

e emin  r -- 


> AtI^‘3{^-A-T^^?  -a  T‘V^-A.  > e > 0,  (2.18) 

—Ip  emin  2 emin  3 emin  4 — 


for  any  ^ [0,T^^]  and  £ [0,X^^]  since  and 

S^'^emin^  - ^^'^ec^*  '^emax  > 0 a solution  of 


(2.19) 
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. j 

‘ ?! 

' 3 


Then  for  any  t and  £ [O.X^„J. 

f 1 T = (A  I^+A  T )T'^^^-A  -A  T'^^^-A.-fA.X 

e'T  =T  ip  3 i emeix  2 emeuc  3 emax  4 5 1 


e emax 


< (A-I^-tA_T  )T‘^^^-A_T^/^  -Ah-^Ac-X, 

Ip  3 imax  emax  2 emax  4 5 Imax 


= -A^  <-  0. 


(2.20) 


Thus  we  have  established  that  there  exists  no  trajectory  which  es- 
capes frcm  the  region 


= ([T  ,T.  ,X^,X-]'^  : T , <■  T < T , 0 T^  < T^  , 

e i 1 r emin  - e --  emax  - i — imax’ 


“ ’‘i :: i *2  i =‘an«<)- 


The  given  initial  point  x^  = [T^q,T^q,0,0]'^  is  in  S since 


T^in  ^ T^q  and  0 < T^^.  Consequently,  any  trajectory  initiating 


frcm  x„  at  time  t = 0 remains  in  S. 


0 


Theorem  2.1  establishes  the  last  remaining  condition  (4)  of 
Theorem  II. 2.1.  Thus,  we  only  have  to  show  condition  (6)  in  Theorem 
II. 2. 2 in  order  to  conclude  the  existence  of  an  optimal  heating  pro- 
gram. 

.Vow  we  make  the  following  two  assumptions: 


temperature  with  I(t)  = I for  all  t e [0,t„]; 

max  f 


2.  T^^  > T^,  where  T^  is  the  equilibriiun  ion  temperature 

corresponding  to  Joule  heating  only. 

The  first  assumption  is  essential  in  order  for  our  problem  to  be 


meaningful.  Otherwise  the  desired  temperature  T^^  can  never  be 


i ’i 
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achieved.  The  second  assumption  refers  to  the  actual  requirement  that 

T is  near  the  ignition  temperature.  It  is  implied  in  this  assump- 
id 

tion  that  neutral  injection  must  he  introduced  over  seme  positive 

time  duration  so  that  the  ion  temperature  can  reach  in  [9] 

it  was  shown  that  the  time-optimal  heating  program  which  steers  the 

system  from  Xq  to  the  target  set  (x  = [T^,T^,X^,X2]  : > T^^j 

in  the  smallest  amount  of  time  is  given  by  I(t)  = I „ for  all  t. 

max 

This  implies  that  there  exists  a critical  switching  time  t^^^  for 

which  there  exists  only  one  trajectory  with  I(t)  = I ^ on  [t,  ,t„] 

niajc  ic  1 

such  that  T^(t^)  = T^^,  and  there  is  no  trajectory  with  T^(t^)  > T^^ 
for  any  switching  time  t^  > In  other  words,  the  set  of 

tj^-admissible  controls  is  nonempty  for  t^  c [0,t^^].  This  shows 
that  condition  (6)  in  Theorem  II. 2. 2 is  satisfied. 

Thus  the  existence  of  an  optimal  heating  program  (I  ,t^)  is 
established . 


5.3.  Characterization  of  Optimal  Heating  Program 

In  this  section,  we  apply  Theorem  4.1  of  Chapter  II  to  the  plasma 
heating  problem  and  derive  necessary  conditions  for  an  optimal  heating 
program. 


First  we  form  the  Hamiltonians  i = 1,2. 

2 n/p 

H^(x,p,l)  = -A^IpT^^/ 

= (P^T-3/^+P^E'^^^)I  + M, 


Hglx.P.l)  = -(Aj^lV^^^+REl)  + Pif‘e+P2fi+P3fl+P4f2  = V 

(3.2) 

T 

where  p = [ p^,P2>P2»Pj^^]  is  the  adjoint  vector  and  S^(t)  and  M 
are  defined  by 

S^(t)  ^EP3(t)T;3/2(t)  + E-^/^p^(t)  - RE.  (3.3) 

M = p^fg+P2fi+(P3X^+p^X2)(ej^T;^' - Aj^iV3/2. 

Since  the  constraint  sets  and  are  given  by 

«1=  1°!-  “s-  (3-5) 

the  maximization  of  and  can  be  performed  as 

max  H,(x*,p*,l)  = H-(x*,p*,0)  = M*(t),  (3.6) 

T ..  r\ 


. . 1 

if  sJJ(t)  < 0 

max  Hp(x  ,p  ,l)  = ) ^ 

'"’2  *”<*>■ 

if  S^J(t)  > 0 

Th-'  transversality  condition  L*  = H„L*  gives 

i tl  ^ t^  6 


( s;(t,+)i  . 

^ W'  1 ' min 

+ M (t^+), 

if 

Sw(ti+)  < 0 1 

M (V^  = 3.  . , 

* * V 1 * 

( S„  t.+)l 
' 1 max 

+ M (t^+)  , 

if 

S^(t3_+)  > 0 ) 

Since  M(t)  and  S^(i)  are  continuous, ( 3. £)  yields 

\(t^)  = 0. 


I 

t (3.7) 


(3.8) 


(3.9) 


This  is  the  switching  condition. 
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When  (3.9)  is  satisfied  on  seme  positive  time  interval 

* 

the  maximum  principle  fails  to  provide  any  information  about  I (t) 
on  this  Interval.  I (t)  and  the  corresponding  trajectory  x (t)  on 
such  an  interval  [t^,t^]  are  commonly  referred  to  as  a "singular" 
control  and  singular  arc  respectively.  Due  to  the  nonlinearity  of  the 
system  equations  ( 1.2a) -( 1.2d) , the  nonexistence  of  singular  controls 
cannot  be  readily  established. 

By  assuming  the  nonexistence  of  singular  controls,  the  fore- 
going results  can  be  summarized  by  the  following  theorem. 

Theorem  3.1.  Suppose  (I  ,t^)  is  an  optimal  heating  program,  then 
it  is  necessary  that 

* 

1.  there  exists  an  adjoint  vector  p such  that 


I -(^H*/ax)'^,  on  [^o’^lM 

P“\  ^ if 

I -(dHg/dx)  , on  ) 


p*(tp  = [0,P2(t^)  ,0,0]”^, 


* -If  . * , * V 

P = p (t^+). 


(3.10) 


(3.11) 


(3.1?) 


where  P2(t^)  = 0 if  T^(t^)  ''  T^^  and  is  unspecified  if 


2.  I (t)  = 0,  on  [tQ,t^)  and 


^ I I 4 , if  S*(t)  V.  0 ) . 

I (t)  = 5 M It  ,t  ];  (3.13) 

( W-  i*-  V‘>  > « > 

3.  the  following  transversality  condition  is  satisfied, 


^1  ~ 


(3-iM 


The  explicit  form  of  (3*10)  is  given  in  Appendix  G.  || 

Proof;  Conditions  (3. 10)  and  {3- 12)  follow  directly  from  condition 

(k.23)  of  Theorem  II. 1^.1.  Condition  (3. 11)  together  with  the  char- 
* . 

acterization  of  P2('t^)  can  also  be  derived  frcm  this  condition. 

^ -tf- 

Suppose  T^(t^)  > T^^,  then  the  final  condition  can 

be  disregarded  since  it  is  not  active.  In  other  words,  our  problem 

can  be  considered  as  a free  end-point  problem.  Therefore  p (t^)  = 0 

and  this  implies  other  hand,  if  = T^^, 

then  the  tangent  plane  TI^  to  at  x (t^)  is  the  hyperplane 

= (x  ; (x,(0,l,0,0)^)  = T.^}.  (3.15) 

Hence  the  condition  p (t^)  J_  11^  can  be  satisfied  by  any  P2(t^) . 

The  other  conditions  were  already  derived.  [( 

Thus,  the  optimal  plasma  heating  program  is  of  "bang-bang"  type 
such  that  the  neutral  injection  current  takes  on  either  the  maximiim 
or  minimum  value. 

Assuming  the  existence  of  a unique  optimal  heating  program,  we 
can  express  the  necessary  conditions  in  Theorem  3-1  as  a three-point 
boundary  value  problem  (ThPBVP) . 

Lemma  3.1.  Suppose  there  exists  a unique  optimal  heating  program 
'I  ,tj^).  Then  x and  p are  solutions  to  the  following  three- 
point  boundary  value  problem: 
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(dH*/5p)'^  I 

(dH;/dp)'^  I 
-(dH'I./dx)'^  j 


» oil  [ ♦ 


, on 


O.itO 


(3.17) 


with  three-point  boundary  conditions  given  by 


X (tQ)  - (T^q,T^q,0,0)  , 

T*(tp  >T^^,  p*(tp  = [0,11,0,0]'^, 

X (t^-)  = X (t^+),  p (t^-)  = p (t^+) 

s;(t;)  = 0, 


(3. IP) 


■w  -» 

where  t]  = 0 if  TQ(tp  > and  ’)  is  unspecified  if  = 

The  optimal  injection  current  I (t)  satisfies  the  maximizing 
condition  (3.13).  || 

Thus,  the  solution  of  the  original  heating  problem  can  be  obtained 
by  solving  this  ThPVP  together  with  the  maximization  condition  (3.13) 
of  the  Hamiltonian  on  the  second  interval  (t^,t^]. 

5 Piecewise  Constant  Neutral  Injection 

In  actual  experiments,  it  is  difficult  to  realize  a continuous 
variation  of  the  neutral  beam  current  with  time.  Moreover,  it  is 
preferred  that  the  injection  current  has  jumps  at  prescribed  switching 
times  rather  than  at  arbitrary  time  instants.  This  leads  to  the  con- 
sideration of  neutral  injection  programs  such  that  the  beam  current 
is  kept  constant  on  each  prescribed  subinterval  of  the  heating  time 


Interval . 
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Let  t^,  i = 1,2, be  the  given  switching  times  such  that 
tg  < t^  < tg  < . . . 2.  consider  a cost  functional  given 


by 


J(I) 


k 

y 

i=l 


[A^I^^(t)'3/^  + REI(t)]dt. 

Vl 


(4.1) 


In  this  section,  it  is  assumed  that  the  constraint  on  the  magnitude 

of  the  beam  current  I(t)  is  given  by  0=1.  < I(t)  ^ I on  every 

' min  — max  •' 

interval,  i.e.. 


I(t)  = e 


i = 1,2,  — ,k. 


(4.2) 


By  assuming  = 0»  'the  subintervals  with  no  injection  are  simply 

indicated  by  I(t)  = 0. 

We  formulate  the  problem  of  minimizing  (4.1)  with  respect  to  I(t) 

as  a parameter  optimization  problem  as  discussed  in  Chapter  IV.  Let  I 

T 

be  the  parameter  vector  [I  ,I  ] . The  constraint  (14-.2)  is 

12  ^ 

replaced  by 


yi)  . yij  - i^)  ;o,  1. 


(li.S) 


The  requirement  that  the  trajectories  reach  the  target  set 
{(Tg,T^,X^,X2)  : T^  > a't  the  final  time  t^  can  be  expressed  as 

h(Xj^(l))  = T^^  - (a,x(tp)  < 0 (k.k) 

T U 

where  a = [0,1, 0,0]  , {•,•)  is  the  inner  product  on  TE  and  x(t^) 

is  the  end  point  of  the  trajectory  x corresponding  to  the  control 


k-1 


I(t)  = 5(1)  = r I. 


i=l  ^ ^^i-l’^i^ 


+ I 


(4.5) 
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Now  the  plasma  heating  problem  is  reformulated  as  follows; 

Problem:  Minimize  the  cost  with  respect  to  I subject  to 

(4.3)  and  (4.4) . || 

We  now  utilize  the  results  in  Chapter  IV  in  deriving  necessary 

* 

conditions  for  an  optimal  I . In  Chapter  IV  the  right  hand  side  of 
the  system  equation  was  ass\«iied  to  be  continuously  differentiable. 
But  f(x,l)  does  not  satisfy  this  condition  since 
differentiable  in  at  two  points.  We  need  to  approximate 

by  seme  continuously  differentiable  function  of  T^.  One  possible 
form  of  approximation  may  be  a polynomial  of  T^.  Henceforth  we 
assume  that  is  replaced  by  its  continuously  differentiable 

approximation . 

The  Hamiltonians  H^  on  subintervals  [t^  I’^i^’  ^ " l,2,...,k 
have  identical  forms 


H^(x(t)  ,p(t),I^,XQ)  = Sy^(t)l^  +M(t),  i = l,2,...,k,  (4.6) 


where  S^(‘t)  and  M are  given  by 


S^^(t)  = Ep^(t)T;3'^(t)  + E'^^\(t)  - XqRE, 
M = p^f^  + p^f^  + (p^Xj^  + Pi^X2)(G^T;^/^  + 


{^■1) 


(1^.8) 


Then  for  i = l,2,...,k 


(x(4)  ,p(t)  ,Ij^,^q)  = S^(4) 


(>+.9) 


does  not  depend  on  explicitly. 

Theorem  4,1.  Suppose  I = . ,Ij^]  is  optimal,  then 

* 

1.  There  exists  an  adjoint  vector  p which  satisfies 


P (t) 


^ (t)  I (t)  - ^ (t),| 


(I+.IO) 


where  u*  < 0 {v*  =0  if  T^(t^)  > , and  I (t)  = 

''Kl)-,  , 


2.  Case  i)  J S^(t)dt  = 0. 
^i-1 


;4.11) 


Then  is  given  as  a solution  of  (4-,ll). 


Case  ii)  j S^(t)dt  / 0,  then 


, when  S^(t)dt  < 0, 


^ I 

* ^max’ 


« i , . 

when  J S^(t)dt  > 0. 
^i-1 


I (^.12) 


Proof;  The  condition  (4.10)  ccjnes  from  (IV. 3. 4)  in  Theorem  IV. 3. 1 and 
dH*  dS*  ^ 

^ ^ I^  + , on  [t^_^,t^),  i = 1,2, ...,k.  (4.13) 


Condition  (4.11)  and  (4.12)  follow  from  (4.9)  and  Theorem  IV. 3. 2. 


It  is  interesting  to  compare  the  optimality  condition  (4.11)  and 
(4.12)  with  (3.13)  and  (3*1*+)  in  Section  5.3*  We  notice  that  (4.12) 
’’approximates"  (3.I3)  in  the  sense  that  as  ^1  limit 

of  (4.12)  coincides  with  (3.I3).  In  a similar  manner,  as  i^ 
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the  limit  of  (l+.ll)  coincides  with  the  switching  condition  (3.1U). 

In  the  next  chapter,  the  two-temperature  model  of  the  plasma  will 
be  simplified  to  a single  temperature  model,  for  which  the  optimal 
heating  program  can  be  characterized  in  greater  detail. 
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CHAPTER  VI 

SIICLE-TEMPERATURE  MODEL  OF  PLASMA 

In  this  chapter,  the  minimum  injection  energy  plasma  heatii^ 
problem  is  discussed  using  the  simplified  sirgle-temperature  model . 
The  problem  of  ion  t e mp  e r at  ure  stabilization  using  several  forms 
of  feedback  control  is  also  discussed. 

6 .1 . Single-temperature  Model  of  Plasma  and  Minimun  Injection  Energy 
Heating 

In  the  recent  T.F.R.  neutral  injection  experiments,  it  was  ob- 
served that,  when  neutral  injection  was  introduced  after  the  ion  and 
electron  temperatures  approached  their  equilibrium  temperatures  T. 
and  T^  (corresponding  to  Joule  heating  only),  the  electron  tempera- 
ture did  not  vary  significantly  durii^  the  neutral  injection  period. 
This  may  be  explained  by  the  fact  that  the  electrons  are  in  a very 
high-loss  regime  when  the  plasma  current  1^  is  sufficiently  large 
[8  ]. 

In  such  a case,  the  electron  temperature  T (t)  may  be  approx- 
imated  by  the  constant  T^,  and  the  two-temperature  model  (V.1.2) 
may  be  simplified  to  a single-temperature  model  having  two  equations: 
one  for  the  ion  temperature  (T^)  and  the  other  for  the  injected 
power  transferred  to  ions  (X^).  The  relevant  equations  are: 


i 


1 
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T.  = - h(T. ;Ip)  + j 

= c^I  - = fgCXg,!),  j 


(1.1) 


with  initial  conditions  at  t = 0 , 


T,(0)=T_,  X_(0)  = 0, 


(1.2) 


where 


--3/2 
'^i  ■ -^3^6 


Cg  = 


c = c.  = C + C 

3 ^ 4 1 e 2 

hdiiip)  = E^)T^  + 


(1-3) 


In  this  chapter,  we  shall  use  this  model  to  discuss  various  problems 


co;Tcerning  the  plasma  heating  process. 


First,  we  consider  the  following  minimum  iqput  energy  plasma 


heating  problem  which  is  a reformulation  of  the  problem  discussed  in 


Section  5»1*  Throughout  this  chapter,  ^ is  assumed  to  be  zero. 


Ibte  that  we  are  employi:^  the  multi-stage  formulation.  The  aug- 


mented control  constraint  set  U is  given  by 


fi=  {[I,v^,v^f  : [0,l,of  or  [l,0,lf  and  I e ]} . 


(1.4) 


Problem!  Given  system  (l.l)  with  initial  conditions  (1.2);  a fixed 


heatirg  time  [0,t^];  and  an  augmented  control  constraint  set  ^ 


* -Jb 

(1.4).  Find  an  optimal  augmented  injection  program  (I  ,v  ) such 


that  (I  (t),v  (t))en  a.e.  on  [0,t-]  sind  the  iji)Ut-energy  J(l,v) 


given  by 


Ti 


(1.5) 


J(l,v)  = J + REl(t)v2(t)]dt, 


is  minimized  while  achieving  the  desired  ion  temperature  at 

tf»  i-®-'  ^i^V^^id*  II 

Since  we  have  sissumed  that  T^Ct)  is  constant,  the  Joule  heat- 
ing term  in  (1.5)  is  constant.  Hence  for  a fixed  heating  interval 
[0,t^],  the  total  energy  consumption  due  to  Joule  heating  is 
constant.  Thus  we  may  eliminate  the  Joule  heating  term  from  the  cost 
functional  (1.5)  and  reduce  the  above  problem  to  a minimum  injection 
energy  problem.  Furthermore,  since  the  value  V2(t)l(t)  is  equal  to 
l(t)  a.e.  on  [0,t^]  under  the  constraint  (1.**^),  we  may  identify 
V2(t)l(t)  with  l(t).  Consequently,  our  problem  can  be  simplified 
to  the  following  standard  optimal  control  problem. 


Problem  (S);  Given  system  (1.1)  with  initial  conditions  (1.2),  a 
fixed  heating  time  interval  [0,t^],  and  a control  constraint  set 

r 1 * 

= 10,I  _„J.  Find  an  optimal  injection  program  I such  that 

I (t)  e n a.e.  on  [0,t^]  and  the  injection  energy  J(l)  given  by 

tf 

J(I)  = J REI(t)dt,  (1.6) 

0 

is  minimized  while  achieving  the  desired  ion  temperature  at 

t = t^,  i.e.,  T^(t^)  > II 

For  this  formulation,  we  note  that  the  no-injection  stage  is 

simply  represented  by  I(t)  = 0 since  0 e II  by  the  assumption  that 

I,  =0.  If  I.  0,  then  f must  be  modified  to 
min  min 
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n . lio)  u 


(1.7) 


f 


f 


« 


t 


9 


» 


» 


in  order  to  include  the  no-injection  stage.  As  we  have  discussed  in 
Chapter  III,  a nonconvex  constraint  set  such  as  fi  causes  consider- 
able difficulty  in  the  analysis  of  optimal  solutions. 

The  existence  of  an  optimal  injection  heating  program  I for 
problem  (S)  can  be  established  with  the  help  of  a standard  existence 

theorem  presented  in  Appendix  A.  In  fact,  if  the  set  of  admissible 

* 

controls  can  be  shown  to  be  nonempty,  then  the  existence  of  I is 
guaranteed  since  all  other  conditions  are  satisfied.  For  this  pur- 
pose, it  is  sufficient  to  assume  that  T.(t„;I  ) > T. , as  we  did 

in  Section  5.2,  where  T.(t  ;I  ) is  the  ion  temperature  at  the 

1 I insix 

final  time  t.  with  I(t)  = I for  all  t e [0,t„]. 

I max  I 

Let  equilibrium  ion  temperature  with  l(t)  = 

I for  all  t.  Henceforth  assume  that  T.(I  ) > T.,,  which  is 
max  1 max'  id’ 

obviously  required  in  order  to  have  T.(t„;I  ) > T. ..  Also  assume 

^ if  max'  — id 

that  T^^  is  strictly  greater  than  the  equilibrium  ion  temperature 
corresponding  to  Joule  heating  alone.  This  assumption  implies 
that  neutral  injection  must  be  introduced  for  sane  positive  time  dura- 
tion in  order  to  heat  the  ions  to  T.,. 

id 

In  the  following  section,  we  discuss  the  characterization  of  an 

■X 

optimal  injection  program  I in  detail  and  give  a simple  algoritiim 

X 

for  the  canputf tion  of  I . 
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6.2.  Characterization  of  Optimal  Heating  Program 
We  start  with  the  following  result. 

Theorem  g.l.  The  optimal  heating  program  I (t)  for  Problem  (S)  is 
given  by 


I , when  p*(t)  > I 

^ I in&x  \ 

I (t)  = 


0 , when  p^Ct)  HE 


3/2  j ’ 


(2.1) 


★ q/p 

provided  that  Pp(t)  RE^'  on  any  positive  time  interval,  where 


* *iT 


Pg  is  the  second  ccxaponent  of  the  adjoint  vector  p = [p^jP^l 
satisfying 


p^t)  = 


P2(^f)  = 0’ 


' ^>l(t)  ■ 

{dh(T*(t);Ip)/dT.  Jpj[(t) 

i^{t) 

-C2P*(t)  + %P2(1) 

(2.2) 


with  dh(Tj^(t);Ip)/dT^  4 (dh(T^;Ip)/dT^)  The  values  of  I*(t) 

* /2  ^ * 

at  the  times  when  P2(t)  = RE^  are  determined  so  as  to  make  I 

continuous  frcm  the  right  hand  side.  || 

Proof;  The  Hamiltonian  H for  Problem  (S)  is  given  by 
H(x,p,l)  = -R£;i  + + P2f2(X2,l) 

= (c^p^  - RE)I  + Pif'i(T^.V  - (2.3) 

* 

Suppose  I is  optimal,  then  fran  the  maximum  principle 

M -n  ■*  .T 

1.  there  exists  a nontrivial  adjoint  vector  p = IPj^.p^J 
which  satisfies 
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( * 


p*(t) 


-dH*/dT. 

1 

-6H*/dX„ 


i?h(T^(t);y/dT^}p^(t) 

-C2Pj^(t)  + c^^P2(t) 


(2.4) 


2. 


-M- 

p (t^)  _[  the  tangent  plane  11^  to  at  x (t^);  (2.5) 

H(x*(t)  ,p*(t)  ,l*(t))  = majc  H(x*(t)  ,p*(t)  ,l)  a.e,  on  [0,t„]. 

(2.6) 


Since  = [[T^jXg]  : (2.5)  leads  to  the  condition 

P2(tf)  = 0.  Finally  performing  the  maximization  in  (2.6)  yields  (2,l) 


Note  that  when  P2(t) 


O /p  ^ 

RE^'  I (t)  can  take  on  any  value  in  .Q 


since  the  Hamiltonian  does  not  depend  on  I (t) , Hence  I (t)  can 
be  chosen  so  as  to  make  I continuous  from  the  right  hand  side. 


q/p 

When  P2(t)  = RE-^'  for  seme  positive  time  interval,  the  max- 
imiun  principle  fails  to  provide  any  information  about  I (t)  on  that 
interval.  I (t)  on  such  an  interval  becomes  a "singular"  control 
and  seme  higher  order  optimality  condition  must  be  employed  in  order 
to  specify  I (t).  However,  it  will  be  shown  in  the  next  lemma  that 
no  singular  interval  exists. 

Lemma  2.1.  p^  is  strictly  monotone  in  t and  can  not  be  equal 

to  for  any  positive  time  duration.  || 


! '1 


♦ 

r 


Proof:  First  we  show  that  p^^  / 0.  Suppose  p^Q  = 0,  then  from 
(2.2),  p^(t)  so  on  T,  and  hence  P2('t)  =0  on  T.  This  contra- 

■X"  . 

diets  the  fact  that  p is  nonzero.  Now  frem  (1.3)  and  the  defini- 
tion of  Sjji(Tj^;Ip) » 


J 
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"g  + for  0 < T,  < T_ 

1 p i ' - i il 


5t^ 


f‘ 

;lj  = *<  G + 

G + for 


(2.7) 


where  G = A.^T^ 


-3/2  , I/O 

+ Bj^,  = (B^/(B2lp))^^‘'  and  = 

(B^/(B2lp))^^^.  Obviously  dh(T^;Ip)/9T^  > G for  all  > 0 ex- 

-H-  -M- 

cept  at  and  T^2*  Consequently,  for  = T^(t)  such  that 

^ 'K’ 

dh(T^(t) ;Ip)/dT^  exists  a.e.  on  T,  p^(t)  is  strictly  monotone. 
Now  suppose  that  p^  is  constant  on  sane  interval  [t^jt^]  e T, 
ti  / tg.  Then  from  (2.1;),  Pj^(t)  = Cj^Pg(t)/c2  s constant  since 
P2(t)  = 0 on  [t^jt^].  This  contradicts  the  strict  monotonicity  of 


^r 


Thus  we  have  established  the  nonexistence  of  a singular  inter- 


val. In  the  next  lemma,  we  find  the  maximum  number  of  roots  for 
P2(t)  = Re3/2. 


Lemma  2.2.  The  equation 

Pglt)  = Re3/^,  (2,8) 

can  have  at  most  two  roots  on  T = [0,t^].  || 

Proof*.  The  solutions  to  (2.2)  on  [0,tp]  have  the  forms 

t \ 

tf 

PgCt)  = explc,^(t  - s)}c^p^(s)ds 


7t 


where  is  an  unspecified  constant.  When  p^^  < 0,  it  follows 

from  (2.9)  that  p^(t)  and  P2('t)  are  both  negative  for  all  t e T. 
Hence  (2.8)  has  no  solution.  Now,  assume  that  p^^  >0.  Let 
t e (0,t^)  be  a stationary  point  of  p^)  i.e.,  = 0.  Then, 

we  have  from  (2.2)  and  Lemma  2.1, 

= -C2Pi(^  + Cj^Pg(t)  = -C2P^(t)  <0.  (2.10) 

This  shows  that  any  stationary  point  t is  a local  maximum  point  of 
Pg.  Since  p^  does  not  have  a corner  which  can  be  a local  minimim, 

P2  can  have  at  most  one  local  maximum.  By  Lemma  2.1,  p^  cannot  be 
a constant  on  a positive  time  duration.  Thus  there  exists  at  most 
one  relative  maximum  point  of  Pg  in  (0,t^).  Consequently,  there 
exists  at  most  two  roots  for  (2.8)  on  T.  j( 

Next  we  consider  a special  property  of  the  trajectory  with 

Ii't)  = I for  all  t e T. 
max 

Id-  be  a trajectory 

corresponding  to  the  maximum  injection  I(t)  = for  all  t e T. 

lU&X 

Then  T. (t;I  ) is  the  highest  attainable  ion  temperature  at  any 

1 ITlStX 

time  t e (0,t^].  || 

Proof;  Suppose  there  exists  a trajectory  x = [T^,X2J  correspond- 
ing to  an  injection  program  I,  such  that  T^(t^)  > T^  (t.^  for 

some  time  t,  e (0,t.].  Since  T. (t)  and  T (t;I  ) are  continuous 
there  exists  a time  tg,  0 tg  < t^,  such  that  T^(tg)  = fi(^2’^max^ 


-1 


and  T,(t)  >T,(t;I  for  all  t e (t.,  t ] . Then  we  must  have 

X X m&x  ^ X 


Also  frcoi  (1.1)  and  (1.2),  for  any  injection  program  I, 

t 

X2(t)  = J c exp{-C2(t  - s)}l(s)ds. 


(2.12) 


Frcm  (2.11)  and  (2.12), 


Ti(t2)  - T,(t2;l^^ 


[•2  ~ 

^ " *^2  J ^3  ■ ^max^®‘ 


(2.13) 


Here,  since  I satisfies  the  constraint  I(t)  e n = [0,1  ] a.e. 

on  T,  we  must  have  I(s)  - I <0  a.e.  on  [0,t_].  Conse- 

quently  T.(t„)  - T.(t^;I  ) <0.  This  is  a contradiction.  || 

^ •’  i^  2 1 2 max'  - n 

Now  we  are  ready  to  present  three  possible  forms  for  an  optimal 
heating  program. 


Theorem  2.2.  The  optimal  neutral  injection  heating  program  takes  on 
one  of  the  following  three  possible  forms: 


I*(t)  = 

I 

max 

on 

[o,t^], 

(2.13) 

( I 

on 

[o,t  J ) 

\ max 

’si'  I 

I (t)  = 

F 

1 

/ > 

(2.1U) 

1 ° 

on 

f^sl’'‘^f^  j 

( “ 

on 

[o,to)  1 

I*(t)  = 

' I 

\ max 

on 

^S’^s2^  / • 

(2.15) 

( 0 

on 

[ts2.tf]  ) 
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These  programs  are  illustrated  in  Figure  6.1. 


Proof:  Fran  Lemmas  P.l  and  2.2,  p^Ct)  can  only  assume  one  of  the 
following  three  forms: 


1.  P2(t)  ^ q for  all  t e T; 


2.  I q < P2('t)  i’or  [0,tg^)  I ^ 

I 0 < P2('t)  q * 

3.  0 < pJt)  < q for  [0,t„)  \ 


(2.16) 


(2.17) 


q < P2('t) 


for  (tQ,t^^) 


0 < P2(t)  < q for  (t^j^.t^ 


siM  ’ 

,t,]  f 


(2.16) 


where  q = RE^'  and  ^sl’^s2  *0  solutions  for  (2.8).  By 

Theorem  2.1,  the  cases  (2)  and  (3)  lead  to  the  injection  program  (2.l4) 

and  (2.15)  respectively.  Case  ( l)  corresponds  to  I (t)  = 0 for  all 

t 6 T,  and  is  not  relevant  for  our  problem  since  T^^  > T^.  The 

heating  program  (2.15)  corresponds  to  the  special  case  T.(t„;I  ) = 

T^^.  For  this  case,  by  Lemma  2.3,  there  exists  only  one  trajectory 

x(‘;I  ) which  satisfies  the  final  condition  T.(t~)  >T.,.  There- 

^ ’ max  i'  f — id 

fore  x(’;I  ) is  optimal. 

1 1 

Thus  our  remaining  task  is  to  give  a condition  for  determining 
* 

the  form  of  I for  each  particular  case.  For  this  purpose,  we  look 
in  detail  at  the  various  trajectories  of  T^  in  the  time  domain.  In 
Figure  6.2: 

1.  The  curve  corresponds  to  the  trajectory  with 


max  — i 


intersects  the  line 


T.  = T^,  at  time  t , and  approaches  the  equilibrium  ion 
i id  cJ. 

temperature  T.  (I  ) as  t -♦“.(The  asymptotic  stability, 
i max 

in  the  first  quadrant  of  the  plane,  of  an 

equilibrium  point  ^d^ax^  = corre- 
sponding to  I(t)  = for  all  t > 0 can  be  established 

by  a method  which  will  be  used  in  Theorem  3*1  io  the  next 
section.) 

2.  The  curve  corresponds  to  the  injection  program  (2.14) 

for  seme  t , >0.  After  the  neutral  injection  is  cut  at 
si 

tg^,  the  value  of  X2(t)  decays  exponentially.  Hence 

T.(t)  continues  to  rise  until  it  reaches  a maximum  value 
1 

at  some  time  t^  > T^^,  and  then  decays  monotonically . 

3,  The  curve  corresponds  to  the  special  case  where  the 

maximum  value  T.(t  ) is  equal  to  T...  For  this  special 
1 m id 

case,  the  injection  cut-off  time  t^^  and  the  time  when 

T.(t)  reaches  T . , are  denoted  by  t and  t 

id  ■'  cs  cm 

respectively. 

We  recognize  that  t , ,t  and  t are  known  once  I ^ is 
® cl  cs  cm  max 

* . 

given.  This  suggests  that  we  may  determine  a special  form  for  I (t) 

bv  comparing  t„  with  these  times.  In  fact,  once  t ,,t  and  t 

or  equivalently  the  curves  and  are  computed,  a special  form 

* 

of  I for  a particular  problem  can  be  found  by  comparing  t^  to 

t , and  t 
cl  cm 

We  conclude  this  section  by  summarizing  the  preceding  discussion 
in  the  following  theorem. 
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I. 


ii' 


Theorem  2.3  (Algorithm) . A special  form  of  I for  a given  can 


be  computed  with  the  following  procedure. 


1. 

Find  t , ,t 

cl  cs 

for 

a given 

2. 

Ccmpare  t^  ' 

3- 

If 

^f  ^ ^cl’ 

4. 

If 

^f  = ^cr 

5. 

If 

^cl  < ^ 

and  t by  computing  curves  C,  and 

cm  13 


max 
with  t 


, and  t 
cl  cm 


then  conclude  that  no  solution  exists. 
* , . 


cm’ 


then  set 


I (t)  -J  , - , ’ 

( 0 , on  [tg,t^]  I 


(2.19) 


6. 


Where  t^  is  computed  using  the  condition  T^(t^)  = 
Otherwise,  set 


I*(t)  = 


0 , 

on 

[o,t^  - 

■t  ) 
cm 

I , 

on 

[ t „-t 

max’ 

f cm 

f cm 

0 , 

on 

[t„-t 

I cm 

+t  ,t„ 
cs’  f 

(2.20) 


Proof:  When  t „ < t ,,  Problem  (S)  has  no  solution  since  T. , can- 
f cl  ^ ' id 


not  be  reached.  If  t^  = then  there  exists  only  one  trajectory 

with  T.(t^)  = T. ,,  and  it  is  realized  by  I(t)  = I for  all  t. 

1 I id  V / 


Hence  I takes  on  the  form  (a)  in  Fig.  6.1.  When  t . < t-  < t , 

® cl  f - cm 


I is  of  the  form  (b)  in  Fig.  6.1,  and  the  cut-off  time  t can  be 

s 

computed  from  the  condition  T^(t^)  = Finally,  when  t^  - 

* 

I assumes  the  form  (c)  in  Fig.  6.1.  For  this  case,  the  initializa- 
tion of  the  neutral  injection  is  de 

injection  is  cut  at  t = t^,  + t ^ . 

''  s 0 cs 


tion  of  the  neutral  injection  is  delayed  until  t„  = t„  - t and  the 

0 f cm 
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6.3*  Feedback  Controls  and  Stability 

In  this  section,  we  discuss  the  regulation  of  the  ion  temperature 
about  its  desired  value.  We  consider  two  different  forms  of  feedback 
control.  In  both  cases  the  ion  temperature  is  measured  and  fed 

back  to  control  the  neutral  injection  current  I.  The  effect  of  the 
time  delay  in  a feedback  control  on  the  stability  of  the  total  system 
is  then  discussed. 

First,  we  consider  the  simplest  on-off  feedback  control  such  that 
either  the  maximum  injection  or  no  injection  is  supplied  depending  on 
whether  the  ion  temperature  is  less  than  or  greater  than  the  desired 
value  T . , , 

n /H  ' 


I(t)  = I(T^(t))  = 


Ti(t)  < T.,  j 

Tl(t)  ; ) 


(3.1) 


The  behavior  of  the  complete  feedback  control  system  in  the  first 
quadrant  of  the  T^  - Xg  plane  is  shown  in  Figure  6.3,  where 

the  curves  and 

^1  ’■  ^2  ""  j 


fg  : Xg  = c^I(T^)/C)^, 


(3.2) 


are  the  zero-rate  curves  for  T^  and  Xg  respectively.  Since  fg 

is  discontinuous,  and  Fg  may  not  intersect  and  the  equilibrim 

point  (e.p.)  may  not  exist.  In  fact,  when  T^^  is  less  than  the 

equilibrium  ion  temperature  corresponding  to  I(t)  = I as  is  the 

max 

case  shown  in  Fig.  6.3,  the  curves  F^  and  Fg  do  not  intersect. 
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Hence  there  is  no  e.p.  in  the  usual  sense.  But  the  nature  of  the 
directional  field  indicates  that  the  trajectory  emerging  fran  any 
point  in  approaches  the  neighborhood  of  a point  x shown  in 

Fig.  6.3.  The  results  of  simulation  show  that  the  trajectories 
approach  x in  a spiral  manner  and  endorses  the  above  observation. 

A curve  in  Fig.  6.3  is  a typical  result  of  simulation. 

As  the  trajectory  approaches  the  control  l(t)  oscillates 

rapidly  between  I and  0.  This  oscillation  can  be  avoided  by 
replacing  the  discontinuous  feedback  control  (3*l)  by  a continuous 
feedback  control.  A possible  form  is  given  by 

1 - expl-(T^^-Tj(t))^/aJ].  T^(t)  < T._j  | 

I(T.(t))  = >,(3.3) 

I 0 , < I.(t)  j 

where  a > 0 is  a constant. 

A typical  trajectory  with  this  feedback  control  is  shown  by  Fg 
in  Figure  6.4. 

Now  the  stability  of  an  e.p.  x^,  given  by  the  intersection  of 
and  r^,  is  established  by  considering  the  divergence  of  the 
velocity  vector  and  applying  Bendixson’s  theorem. 

Theorem  3»1-  The  e.p.  x^  in  Fig.  6.4  is  asymptotically  globally 
stable  in  the  first  quadrant  of  T^  - plane.  || 

Proof;  The  divergence  of  the  velocity  vector  f = (f^,fg) 

div  f = (df^/dT^)  + fdfg/SXg)  = -dh(T^;Ip)/dT^  - c^, 

(3.4) 
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is  nonpositive  for  almost  all  since  h is  strictly 

monotone  increasing  and  is  differentiable  except  at  the  two  points 


Til  "^i?  defined  earlier.  Hence  by  Bendixson's  Theorem 


([  7l»(?0])  no  periodic  solutions  or  limit  cycles  can  exist  in 
Now  consider  a rectangular  region  D illustrated  in  Fig.  6.4,  posi- 


tioned such  that  two  sides  are  on  the  T^  and  axes  and  the 


corner  opposite  the  origin  is  on  the  curve  1’^.  D also  contains  the 


nonzero  section  of  1’.,  given  by  (3»2)  and  (3"3)«  The  directional 
field  indicates  that  the  trajectories  are  either  directed  into  the 
interior  of  D or  along  its  boundary.  Since  there  are  no  limit 


cycles  in  D,  the  trajectories  must  converge  to  x as  t -•  ®. 

© 


Furthermore,  since  D can  be  enlarged  to  ccmpletely  cover  Q , x 


is  globally  asymptotically  stable  in  . 


In  an  actual  ion  temperature  control  system,  the  effect  of  time- 
delays  due  to  the  nevitral-particle  transit-time  in  the  injector  and 
the  data  processing  time  associated  with  ion -temperature  measurement 
should  be  considered.  When  the  energy  of  the  injected  particles  is 
in  the  KeV  rang*,  the  transit-time  delay  is  negligible  as  compared 
to  the  ciiaracteristic  time  associated  with  the  energy  exchange  between 
the  ions  and  the  injected  imrticles.  When  the  ion  temperature  measure- 
ment time  delay  is  present,  the  feedback  control  takes  the  form 


1 


on  stability  can  be 


estimated  by  considering  the  equations  of  the  feedback  system  (l.l), 
(3.5)  linearized  about  its  equilibrium  point 


where 


dbT^(t)/dt  = ■v6T^(t)  + C2&X2(t),  j 

d6X2(t)/dt  = c^A6T^(t  - T^)  - Cj^6X2(t),  I 


(3.6) 


■V  = -(c»h(T^;Ip)/dTpi^_  , 


(3.7) 


The  stability  of  or  the  stability  of  the  trivial  solution  of 

(3.6)  is  ensured  when  the  characteristic  equation  for  (3.6)  given  by 


2 

z 


+ (c^-7)z 


c^T  - exp(-T^z)  = 0, 


(3.8) 


has  no  root  with  a positive  real  part.  The  stability  boundaries  in 
the  ' A,t^)  parameter  plane  can  be  found  by  setting  z = 0 and 
z = iy  in  (3-8)  where  y is  real  and  i = /^.  This  leads  to 

A = (c,j)/(c2C^),  (3.9) 


y'"  + + CgC^Acos(T^y)  = 0,  | 

(c^-T)y  + C2C^Asln(T^y)  =0.  J 


(3.10) 


By  solving  (3-10)  for  A and 


in  terms  of  y,  the  stability 


region  is  given  by 


-[  (y^+c^){y^-+7^)  ’I 

X X 2 1 

■^d  - y ly('=4“'v)/(y  +<=47)]  • ' 


(3.11) 


This  stability  region  corresponding  to  actual  parameter  values  is 

shown  in  Figure  6.5.  It  is  evident  that  the  meuclmum  allowable  time- 

delay  is  reduces  as  A beccmes  more  negative. 

Thus  we  have  shown  that  stability  can  be  achieved  by  a suitable 

choice  of  parameters  even  in  the  presence  of  measurement  time-delay. 

However,  since  the  derived  stability  region  in  Fig.  6.5  is  for  the 

linearized  system  (3.6),  it  is  only  applicable  to  the  original  system 

when  the  state  is  sufficiently  close  to  an  equilibrium  point.  In  an 

actual  ion  temperature  regulation  system,  we  may  use  two  modes  of 

operation;  (l)  apply  the  minimimv  energy  heating  program  to  steer  the 

system  state  to  seme  neighborhood  of  an  equilibrium  point  x^,  and 

then  (2)  switch  to  the  feedback  control  (3.3)  regulating  the 

ion  temperature  about  x^.  Note  that  the  equilibrivm  ion  temperature 

T.  is  lower  than  T.  , when  the  smooth  feedback  control  (3.3)  Is 
ie  id 

used.  This  can  be  avoided  simply  by  replacing  T^^  in  (3.3)  with 

seme  T,,  >T.j  so  that  the  curves  1.,  and  I-  intersect  when 
id  id  i c 

^i  - ^id- 


‘>0 


Fig.  6,k,  Typical  Trajectory  of  the  Saooth  Feedback 
Controlled  Injection  Syoten 


stability  Region  in  A(Gain)  - T.( Tine-Delay)  Space 
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CHAPTER  VII 


CONCILISIONS  AND  SHiXiESTIONS  FOR  RJRl’HER  RESEARCH 


7.1  Multiple  St€ige  Optimal  Control  Problems 


Three  classes  of  multiple  stage  optimal  control  problems  moti- 
vated by  the  problems  of  minimum  input  energy  heating  of  toroidal 
plasma  by  means  of  neutral  injection  were  studied.  The  derived  results 
were  utilized  in  analyzing  plasma  heating  problems. 

First,  a two-stage  optimal  control  problem  having  an  integral  cost 
functional  with  an  integrand  which  assumed  different  forms  before  and 
after  an  unspecified  switching  time  was  examined.  The  existence  of 
an  optimal  control  pair  (control,  switching  time)  for  a general  class 
of  problems  was  established  using  properties  of  aupnented  attainable 
sr*.s.  A necessary  condition  was  derived  via  the  methods  of  calculus 
of  variations.  A more  general  necessary  condition  in  the  form  of  a 
maximum  principle  was  obtained  by  deccmposing  the  two-stage  optimal 
control  problem  into  two  stand8a*d  problems.  In  both  cases  an  optimal 
switching  time  was  characterized  by  the  requirement  that  the  Hamilton- 
ians corresponding  to  the  first  and  second  stages  are  equal  at  the  time 
of  switching.  A sufficient  condition  for  the  nonexistence  of  an  opt- 
imal intermediate  switching  was  derived  for  a linear  regulator  problem 
with  a two-stage  quadratic  cost. 

Secondly,  a generalized  multi-stage  optimal  control  problem  was 
considered,  for  which  the  integrand  of  the  cost  functional  was  allowed 
to  change  its  form  fron  one  to  another  among  N given  foms  at  any 


instant  for  any  number  of  times.  This  problem  was  reduced  to  a 


standard  optimal  control  problem  by  introducing  a set  of  auxiliary-  con- 
trols. It  was  shown  that  finding  an  optimal  switching  schedule  is 
equivalent  to  finding  an  optimal  auxiliary'  control.  The  investigation 
of  the  existence  of  an  optimal  auxiliary  control  showed  the  possibility 
of  chattering  controls  due  to  the  fact  that  the  autqnented  control  con- 
straint set  is  never  convex. 

Thirdly,  to  conplj'  with  the  engineering  requirement  that  the  neutral 
injection  program  be  piecewise  constant,  we  considered  a fixed  k-stage 
optimal  control  problem  with  a cost  IXnictional  assuming  k preassigned 
forms  on  k fixed  subintervals.  ITie  control  was  ass\uned  to  bo  con- 
stant on  each  s\ibinterval.  It  was  shown  that  this  problem  can  be  form- 
ulated as  a parameter  optimisation  problem  in  k-dlmensional  Kuclivlean 
space  M by  rect^gni^lng  the  one-to-one  correspondence  between 
vectors  in  ffr  a>id  the  class  of  control  functions  under  consideration. 
The  refonmilation  was  performed  without  any  approximation  and  a necess- 
ary condition  for  an  optinuil  vector  was  derived  in  integral  fom. 

In  regard  to  the  general  two-stage  problem,  it  is  Importatit  to 
find  a condition  which  guarantees  the  nonexistence  of  an  optimal  inter- 
mediate switcliing  as  was  derived  for  a special  case  ii\  Section  2.5.  It 
was  discussed  in  Section  2.3  that  the  optimal  control  pair  is  generall^v 
obtained  by  solvitig  a three-point  boundary  value  problem,  \diereas,  if 
it  is  known  a priori  that  the  optimal  switching  time  is  one  of  the  end 
times,  then  onl,v  a two-point  boundar>’  value  problem  needs  to  be  solved. 

Fran  an  engineering  point  of  view,  the  existence  of  an  optimal 
measurable  control  is  not  sufficient  for  the  multi-stage  problem.  The 
•xistence  of  an  optimal  piecewise  continuous  control  is  essential  for 
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the  multi-stage  problem  since  it  guaurantees  the  finiteness  of  the  opt- 
imal number  of  switchings.  In  general,  certain  additional  regularity 
assumptions  are  required  for  the  existence  of  an  optimal  piecewise  con- 
tinuous control.  For  example,  piecewise  analyticity  of  the  right  hand 
side  of  a system  equation  was  assumed  in  [21]  so  as  to  insure  the 
existence  of  an  optimal  piecewise  continuous  control  for  the  case  of 
linear  systems.  Problems  with  more  general  systems  are  still  remaining 
as  subjects  for  further  research. 

Another  interesting  variant  of  the  multi-stage  problem  would  be 
to  consider  the  case  where  the  maximum  number  of  switchings  is  fixed. 

For  this  case,  the  existence  of  an  optimal  solution  may  be  shown  by 
utilizing  the  finiteness  of  the  maximum  lumber  of  switchings.  Put  it 
appeared  to  be  very  difficuilt  to  characterize  an  optimal  solution 
under  such  conditions  as  this,  since  a fixed  maximim  number  of  switch- 
ings implies  a fixed  maximum  number  of  discontinuities  of  auxiliary 
controls . 

It  should  be  noted  that  we  could  have  allowed  the  system  equation 
as  well  as  the  cost  functional  to  change  its  form  at  the  switching 
times.  The  extension  of  the  derived  results  to  this  case  may  be 
carried  out  without  difficvilty. 

The  multiple  stage  optimal  control  problems  considered  in  this 
dissertation  are  very  general  and  are  applicable  not  only'  to  plasma 
heating  problems  but  also  to  other  practical  problems.  For  example, 
the  problems  with  abrupt  change(s)  in  the  cost  criterion  and/or  system 
equation  at  unkjiown  time(s)  may  be  formulated  as  either  a two-stage  ora 
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multi-stage  optimal  control  problem  and  may  be  solved  utilizing  the 
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res\ilts  presented  in  this  dissertation. 

7.2  Plasma  Heating  Problem 

Tlie  problem  of  minimum  input  energy  plasma  heating  by  means  of 
nevitral  injection  was  formulated  as  a two-stage  optimal  control  problem 
using  a two-temperature  model  of  the  plasma.  This  mathematical  optimi- 
zation problem  was  shown  to  be  meandngful  by  showing  the  existence  of 
an  optimal  solution.  The  derived  optimal  heating  problem  is  of  "on- 
off"  tjTpe  so  that  the  implementation  would  not  cause  any  serious 
difficulties.  In  case  physical  conditions  require  the  switching  of 
neutral  beam  current  at  certain  time  instants,  we  can  adopt  the  optimal 
piecewise  constant  injection  program  discussed  in  Section 

Criven  the  present  technology  the  energy-  consximption  due  to  neutral 
injection  can  0!ily  amount  to  a small  percentage  of  that  due  to  Joule 
heating.  However,  in  the  future  large  machines  such  as  the  J.E.T. 

(Joint  European  Tokomak)  neutral  injection  will  be  the  primal  source  of 
plasma  heating  and  its  energy  consumption  will  become  a dominant  part 
of  the  total  input  energy.  In  such  cases,  the  heating  system  is  re- 
quired to  operate  at  levels  of  high  efficiency  so  that  energy  extract- 
ion from  the  plasma  is  possible.  Therefore,  the  optimal  heating  prob- 
lem considered  here  will  become  verj'  important  since  emplojinent  of 
the  optimal  heating  program  will  result  in  a significant  conservation 
of  the  input  energ.v. 

The  detailed  characterization  of  an  optimal  heating  program  was 
carried  out  using  the  simplified  single-temperature  model  of  the  plasma. 
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It  was  shown  that  the  optimal  neutral  injection  program  takes  on  oae  of 
the  three  possible  forms,  all  of  which  are  of  "on-off"  tj,T)e.  The 
special  forms  for  individual  cases  can  be  determined  simply  by  ccmpar- 
ing  the  heating  time  duration  to  the  two  critical  times  which  can  eas- 
ily be  ccmputed  once  all  the  parameters  are  given. 

The  investigation  of  feedback  regulation  of  ion  temperature  showed 
that  stable  equilibrium  ion  temperatures  can  be  achieved  for  several 
types  of  feedback  controls  even  in  the  presence  of  ion  temperature 
measurement  time-delay.  This  suggests  the  possibility  of  the  auto- 
matic ion  tanperature  regulation  using  feedback-controlled  neutral 
injection. 

It  should  be  noted  that  the  two-temperature  model  of  the  plasma 
is  a highly  simplified  model  and  there  are  several  limitations.  It 
would  be  important  in  future  studies  to  include  the  djTiamics  of  the 
neutral  beam  injector  in  this  model.  As  the  magnitude  of  neutral  in- 
jection beccmes  large,  the  underlj'ing  physical  characteristics  of  the 
injector  become  important  factors  in  considering  efficient  plasma  heat- 
ing. In  fact,  it  is  known  that  as  the  kinetic -energy'  of  the  accel- 
erated ions  beccmes  large,  the  efficiently  of  the  neutralizer  drops 
significantly.  Also  in  the  future  large  machines,  the  kinetic -energj' 
of  the  neutral  particles  will  be  required  to  be  much  larger  than  that 
in  the  existing  machines,  since  the  penetration  depth  of  the  neutral 
particles  into  the  plasma  must  be  greater.  The  other  limitation  of  the 
two-temperature  model  is  that  the  characteristics  of  the  plasmas  re- 
lated to  their  sjatial  temperature  profiles  are  not  revealed  using  this 
model.  For  example,  it  has  been  proposed  that  the  transition  of  the 
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electron  diffusion  law  frcm  one  regime  to  another  depends  on  the  spatial 
electron  temperature  gradient.^ 

Finally,  it  would  be  interesting  to  consider  the  dynamics  of  the 
electron  and  ion  densities  since  the  plasma  density  is  one  of  the  three 
important  parameters  characterizing  the  nuclear  fusion  reaction.  The 
problem  of  obtaining  the  maximum  ion  density  by  means  of  neutral  in- 
jection would  be  an  important  and  interesting  problem  to  consider. 


^Personal  conversation  with  M.  Cotsaftis, 
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APPENDIX  A 


STANDARD  EXISTENCE  THEOIiEM 

Consider  the  following  optimal  control  problem: 

Problem.  Given  a system  x z=  f(x,u,t),  a control  time  interval 
[tQjt^],  terminal  conditions  x(tQ)  t and  x(t^)  € X^  where 
Xq  and  X^  are  nonempty  closed  sets  in  and  a control  con- 

straint set  C(t)  € t€  [tpjt^],  find  an  admissible  control  u 
which  minii'\izes  the  cost  functional 

r^f 

J(u)  = L(x(t) ,u(t),t)dt,  (A.l) 

i.e.,  J(u  ) ^ J(u)  for  any  admissible  control  u.  (A  control  u 
is  said  to  be  admissible  if  (l)  u(t)  e fi(t)  a.e.  on  [t^,!^],  and 
(2)  the  corresponding  trajectory  cp  satisfies  •T('tQ)  e X^  and 

T(t^)  € X^.)  II 

We  state  the  following  Lemma  without  proof.  (For  a proof, 
refer  to  [ 3 ] • ) 

Lemma  A.l.  Assume  that  the  following  hypotheses  are  satisfied. 

1.  The  set  of  admissible  controls  A is  nonempty; 

n+1 

2.  There  exists  a compact  set  ( E such  that  for  all 

atimissible  trajectories  q',  (t,q'(t))  e for  all 

t t [ty,t^]; 

3.  at  any  t e ttQjt^],  for  every  E -0,  there  exists  a 
6(e)  ''0  such  that  for  t e 
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|t-T|  < 5(e)  Implies  CXt)  Is  contained  In  a closed 
e-nelghborhood  of  fXr); 

U.  the  set  Is  compact  for  all  t t [t^.t^]; 

5.  for  each  (t,x)  c ft,  the  set  v'*'(t,x)  Is  convex,  where 

v'*'(t,x)  = {y  = (yQ,y)  t IE"'^^:yQ  > L(x,u,t), 

y = f(x,u,t),  u € n(t)j,  (A.l) 


and  ft  c ]E“  Is  an  open  set  such  that  c ft; 

6.  L Is  lower  semi -continuous  and  f Is  continuous  In  ft  x U, 
where  U c ]E°  Is  an  open  set  such  that 

* 

Then  there  exists  an  optimal  control  u such  that 


J(u  ) < J(u) 


for  all  admissible  u. 


APPENDIX  B 


CCMRITATION  OF  FIRST-ORDER  VARIATIONS 

Let  (u  ,tj^)  and  x be  an  optimal  control  pair  and  a corre- 
sponding optimal  trajectory.  Let  (u,tj^)  and  x be  a perturbed 
control  pair  and  a corresponding  trajectory  such  that, 

(u,tj^)  = (u*  + EV,t*  + et),  (B.l) 

A ■» 

X = X + ey,  (B.2) 

where  e > 0 and  (v,t)  and  y are  respectively  a perturbation 
pair  and  their  corresponding  trajectory  variations.  It  is  known 
that  y obyes  the  variational  equation 

y = (df*/dx)y  + (df*/du)v.  (B.3) 

* 

Assume  initially  that  t^^  e (tQ,t^).  The  other  cases  will  be  treated 
later.  Here  we  use  the  superscript  to  denote  optimality  and 

to  denote  a perturbed  quantity. 

First  we  introduce  two  functions.  Let  p be  a differentiable 
adjoint  vector  which  satisfies 

p = (c^L^/ax)"^  - (df/dx)'^p,  (B.4) 

where  i = 1 on  and  i = 2 on  (t^,t^].  Let  the 

Hamiltonian  Hj^(x,p,u,t)  be  defined  by 

Hj^(x,p,u,t)  = -Lj^(x,u,t)  + p'^f(x,u,t)  i = 1,2.  (p.5) 
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Using  (B.5),  (B.4)  can  be  simplified  to 

p = 

Now  the  cost  corresponding  to  a perturbed  control  pair 
is  given  by 


(B.6) 


A 


J(u,tj^)  = J L^(x,u,t)dt  + L2(x,u,t)dt. 


(B.7) 


By  adding  terms  which  are  identically  zero,  we  get 

A . 

J(u,A  = j + p'^(x-f)]dt  + [Lg  + p'^(i.f)ldt 

t/^  t. 


= J [p  x-H^]dt  + J tp  x-Hgldt. 


At  each  instant  of  time,  can  be  expanded  as 


+ e(dHj^/dx)y  4 e(dH^/du)v  4 o(e). 


Substituting  (B.3)  and  (B.9)  into  (B.8)  yields 
t^ 

.T 


'*  ^ T * 


(B.8) 


(B.9) 


J(u,t^)  = j [p  X 4 e{p  y - (dHj^/dx)y  - (dHj^/du)v}]dt 
^0 

tf  ^ ^ 

4 J [p'^x  -H*4e{p'^y  - (dHP'dx)y  - (dH^du)vJ)clt  + o(e) 

4. 

t,  tf 

? r T.*  *1  i , T.*  *1 

= J [p  X - H^]dt  4 J tp^i  - Hgldt 

^0  ^1 

t 

- e J 4 (dH*/dx)’^fy  - (dH*/du)v]dt 
*0 

[{p  + (dH*/dx)'^)’^y  - (dH^du)v]dt 


- e 


103 


(B.IO) 


r/  T .*  * >.  , T.*  * V, 

+ e[{p_  x_  - - (p^x^  - 

T T T T 

■*■  e[(p_y_  - Pgyg)  + (p^yf  - P+y+)l  + o(e)* 

where  the  subscripts  "0"  and  "f"  denote  the  left  and 

■» 

right  limit  at  t^  and  evaluation  at  t^  and  t^  respectively. 
Since  Yq  = 0 (x^  = x(tQ)  is  fixed)  and  p satisfies  (B.6), 

equation  (B.IO)  can  be  simplified  by  ccmbining  the  first  two  inte- 
grals  to  give  J(u  ,t^)  . 

J(u,t^)  = J(u  ,t^)  - ^ t j ^ (dHj^/du)vdt  + j ^(dHg/du)vdt] 

+ e[p_i_  - p;^x_^  - 

X T T 

+ e[p^^  + P_y_  - P^y^l  + o(e).  (B.ll) 


Here  the  perturbations  y ,y^  and  t satisfy  the  following  rela- 
tion (see  Fig.  A.l): 


= y_  + (x_  - x^)i 


(B.12) 


Using  this  in  (B.ll),  we  get 

J(u,t^)  = J(u*,t^)  - e[  J (c»H^/&u)vdt  + j (SH^&u)vdt] 


0 "] 
+ e[(p_  - p^)"^  i*  + (-H^_  + 


T T 

+ e:(p_  - p_^)  y_  + ep^^  + o(e), 


(B.13) 


Hence  the  first  variation  EJ 


■»  ■)*, 


J(u,t^)  - J(u  ,tj^) 


lOU 


bJ  = 11m 

t-0 


9 


(B.lU) 


r 


f 


is  given  by 


■* 


8J  « - j (dH*/du)vdt  - j (dH^&u)vdt  + (p_  - P^)'^y_ 


'to  - ^t, 

vT.«  . , . * . * X,  . _T 


1 

* * 


+ [(P_  - P^)  i_  + (-H^_  + + p^y^ 


(B.15) 


# ■». 


For  optimality  of  (u  ,tj^) , EJ  must  be  zero  for  any  perturbations 
V,  y , T and  y^.  Hence  we  finally  arrive  at  the  following  set  of 
conditions . 


dHj^/du  (t)  = 0,  iKl,2t 


p{tp  = 0, 


P(tj^_)  = P(^i+)» 


■»  * 

H-I  L->t  “ • 

^ ^1-  ^1+ 


(B.16) 

(B.IT) 

(B.18) 

(B.19) 


When  tj^  is  at  one  of  the  end  points,  the  perturbation  at  t^^ 
cannot  be  arbitrary.  For  example,  suppose  t^^  = tQ  then  t must 
be  nonnegative  so  that  t^^  = tQ  + pt  e [tQ.t^l,  For  this  case,  the 
fir»t  order  optimality  condition  is  given  by 

(B.20) 


EJ  ''  0. 


After  eliminating  the  terms  connected  with  the  variations  in  u and 
X (we  note  that  the  conditions  (B.lb)  and  (B,17)  remain  satisfied 


since  and  v are  arbitrary),  we  have 


■»  T * * T ♦x 

EJ(t)  - - V 


(B.21) 


Hence  we  must  have 
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W 


k 


(B.22) 


The  other  case  where  t^  = t^  can  be  treated  similarly.  In  fact, 


eJ(T)  = (L^_  - pV  - + pV)t, 

with  T ^ 0 for  this  case.  This  and  (B.20)  give 


(B.23) 


Notes : 


(t^),p(t^),u_,tp  > H2(x^(t^),p(t^),u^,t^).  jj  {B.2k) 


(N.l)  u and  u at  t = t„  and  t 


at  t = t^  and  t^,  are  solutions  of 
(dHydu)(x(t),p(t),u_,t)  1^^^^  ^ =0,  (B.25) 


(aH^du)(x(t),p(t),u  ,t)|  . =0.  (B.26) 

0 ^f 

fN.2)  If  we  consider  J (t.)  = J(u,  ,t. ) to  be  a function  of  t 

X T-i  i 1 

as  we  have  done  in  Section  2.2,  then  the  first  order  var- 
iation  of  J with  respect  to  t^  is  actually  given  by 


In  fact  we  have 


d.T^t^)/dt^  = ^ 


(B.27) 


(B.28) 
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APPENDIX  C 


MAXIMUM  PRINCIPI£ 

Recall  the  optimal  control  problem  considered  in  Appendix  A. 
Assume  that  f and  L are  continuously  differentiable  in 
IE”  xlfVlE.  Let  the  Hamiltonian  be  given  by 


H(x,p,u,t)  = -L(x,u,t)  + p^f(x,u,t). 


(C.l) 


Suppose  u is  optimal,  then  it  is  necessary  that 

* 

1.  there  exists  a nonvanishing  adjoint  vector  p which 
satisfies 

p (t)  = -(dH/dx)'’^(x*(t),p*(t),u*(t),t) 


p^Ct^)  _[  the  tangent  plane  to  Xq  at  x (t^),  / {C  .2) 

P (tp  the  tangent  plane  to  X^  at  x (t^), 

H(x*(t) ,p*(t) ,u,t)  = H(x*(t),p*(t),u*(t),t) 


2. 


max 

uefi 


a.e.  on  [t^jt^]. 


(C.3) 


Remarks ; 


(R.l) 


(R.2) 


When  the  final  time  is  free,  then  at  an  optimal  final  time 
* 

t^  we  have 

H(x  (tp,p  (tp,u  (tp,tp  = 0.  (C.t) 

When  Xq  and/or  X^  is  reduced’ to  a point,  P^Ctg)  and/or 
p*(tp  can  take  on  any  value.  When  X^  = lE^  (correspond- 
ing to  free  end  point),  p (tp  = 0. 


t 


1.3)  When  the  cost  functional  incluaes  a terminal  cost,  i.e., 

J(u)  = J L(x(t)  ,u(t)  ,t)dt  + K(x(tp,tp,  (C.5) 


and  = E , we  have 


P*(t*)  = (?iK/dx)(x*(t*),tp, 


= -(dK/dt  )(x*(t*),tp, 


(C.6) 


where  K is  assumed  to  be  continuously  differentiable  in 


DE”  X ffi 


The  maximum  principle  was  originally  proved  by  Pontryagin  et  al. 


[ 371. 
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APPENDIX  D 

KUIIN-TUCKER  CONDITIONS 


A statement  and  discussion  of  the  Kuhn-Tucker  conditions  can  be 
found  in  any  standard  text  on  methematical  programming.  (For  example. 
Chapter  3 of  Canon,  Callum  and  Polak  [ 6 1).  We  present  the  following 
I;einma  without  proof. 

Lemma  D.l.  Consider  the  following  nonlineax  programming  problem  on 


E 


•.m 


minimize  J(u), 

subject  to  g^(u)  <0,  i = l,2,...,k, 
rj(u)  = 0,  j = 1,2,. ..,X. 


(D.l) 


Let  u solve  this  problem.  Assume  that  J,  g.  and  r.  are 

^ J 

differentiable  at  u . Then  there  exist  a set  of  nonpositive  multi- 
pliers  and  a set  of  multipliers  U2»U2*  • • • 


that 


1.  X4g^(u  ) = 0,  i=l,2,...,k;  (D.2) 

h X 

2.  V f(u*)  + D X.  V g (u  ) + 'D  [i.  r (u  ) = 0.  (D.3) 

^ i=l  ^ j=l 
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i 
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APPENDIX  E 


CGMKJTATION  OF  GRADIENT  VM(u) 

u - 


Recall  that  y M(u)  has  three  terms 
u - 


V^M(u)  = \J7^J(u)  + M.Vh(x^(u))  + Z X^y,g,.{u). 


i=l 


i 


(E.l) 


We  will  calcuJAte  each  term  separately.  First  consider  • 

Frcd  (IV. 2. 3),  we  get 


1 0 » i / j 

^ (u)  =. 

■^i  ]2{u,-(v  -w  )/2j,  i = j 


(E.2) 
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Hence 


1=1  — 


2X^(u^  - 
2X2(112  - U2) 

J 


(E.3) 


where 


= (i^j^  ■*■  i = ly2y...jk. 

Next  compute  V^h(x^(u)).  Let  i = 1»2,  ...,k,  then 

(dh(x^(u))/duj^)  = (dh(Xj^)/9x^)(3Xj^/du^) 

(E.4) 

Let  x(t;t^  I’^i  l’'^!^  solution  trajectory  of  the  system 

equation  (iV.l.l)  on  a subinterval  [t^  l*^i^  such  that 


f ' 
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^i-1 -1  *^i -1 ~ *i-l*  I 

Then  x(t;t^  l**i-l’^i^  written  as 

,t 

x(t;ti_i,x^_l,Ui)  = x._^  + j f(x(T;t^_^,x^_^,u^),u^)dT. 

(E.6) 


By  differentiating  both  sides  by  u^,  we  get 


dx' t ;t^^^,x^^^,u^)/du^ 


j [ l(df/dx)(x(T;t^_^,x^_^,u^),u^) il(Sx/du^)(T;t^_^,x^_^,u^) } 


+ (df/du^)(x(T;t^_^,x^_^,u^) ,u^)ldT. 


(E.T) 


This  shows  that  dx(t)/du^  on  [t^  I’^i^  satisfies  the  initial 


value  problem 


Id'Sx/du  )/dt}(t)  = f (x(t),u  ) {(dx/du  )(t) ) + f (x(t),u  ), 

i X 1 1 U 1 

dx/du^)(t^_^)  = 0, 


(E.8) 


where  the  subscripts  x and  u denote  partial  differentiation  with 


respect  to  x and  u respectively.  Hence  on  [t^  I’^i^ 

t 

(dx/du^)(t)  = J «(t,T)f^(x(T),U^)dT, 


(E.9) 


'rfhere  ‘tft.x)  is  the  state  transition  matrix  of  the  system  (E.8), 


i.e. , 


d4(t,T)/dt  = f^(x(t)  ,u^)'.'(t,T) , 
i(T,T)  = I. 


(E.IO) 
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Therefore  dx^/cHi^  is  given  by 

A 

dx^/du^  = J 'l-{t^,T)f^(x(T),u^)dT.  (E.ll) 


i-1 


Now,  by  differentiating  (E.6)  with  respect  to  x^_j^  and  replacing  i 
with  j,  we  have  for  t € 

t 

(dx/dx.  J(t)  -1=1*  f (x(T),u.)l(ax/dx  J(T)}dT. 

.l-X  t/i.  X 1 J”-*- 


'^3-1  (E.12) 

Again  this  shows  that  (dx/dx^  j^){t)  is  a solution  of 

U(dx/dx  )/dt}(t)  = f (x(t),u  ){(dx/dx  ,)(t)j, 

J —X  Jt  J J 

(dx/dXj_j^)(tj_^)=  I. 


(E.13) 


By  comparing  (E.I3)  with  (E.IO)  we  immediately  have 


Using  (E.P)  and  (E.lU),  (E.U)  can  be  written  as 


(E.14) 


(dh/du^)(x^(u))  = 

r^i 

= J ^(t^,T)f^{x(T),U^)dT 


i-1 


r i 

= (dh/dXj^)  ^ ■5>(tj^,T)f^(x(T),Uj^)dT 

This  gives 


(B.15) 


^i-1 
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r 


^i.(dh(Xj^)/aXj^)  ^(tj^,T)f^(x(T)  ,Uj_)dT 

tp 

^^^h{x^{u))  = M.(ah(x^)/Sx^)  l'(tj^,T)fy(x(T),U2)dT  {E.16) 

t : 

M.(ah(x^)/Sx^)  J*^  $(tj^,T)f^(x(T),Uj^)dT 

Now  we  proceed  to  the  final  tern  ^J(u).  Since  x{t),  t 
does  not  depend  on  u^,  we  have 


(dj/du.)(u)  = d{  E 

1 4 n 


23  I L (x(T),u.)dT}/du 

j=l  •'t.  1 ^ ^ 


= J ^ [Lj^(x(T),Uj){(dx/dUj^)(T)} 

+ Lj^(x(t),Uj)  (du^/du^)  ]dT 


= j L^^(x(T),Uj,)dT 

^i-1 
k 

+ 23  j Ljjj(x(t)  ,Uj)  {(dx/dUj.)(T)  }dT 

Again  by  (E.9)  and  (E.lU^),  for  T ^ t^ 

(ax/dUj^)(T)  = J ^(T,3)f^(x(3),Uj^)dS. 

^i-1 

Substituting  (E.9)  and  (E.l8)  into  (E.17)»  we  get 
ti 

(dJ/au^)(u)  = J [L^^(x(t),u^) 

+ L^^(x(t),u^)  j $(T,8)f^(x(s),u^)ds ]dT 


(E.17) 


(E.18) 


k ^i 

+ S j I'jjj(x(t),Uj)J  $(T,s)f^^(x(s),Ui)dsdT. 
j=i+l  ‘t j_2^ 


(E.19) 


llU 


By  interchanging  the  order  of  integration  and  rearranging  terms, 
(E.I9)  can  be  expressed  as 


aJ(u)/Su^  = J [ J Lj^(x(T),up$(T,s)dT]f^(x(s),u^)ds 

^3-1 

[Liu(x(8)>Ui) + J L^^(x(T),U^)$(T,s)dT  f^(x(8),U^)]dE. 

(B.20) 


For  notational  simplicity,  let 


A 


L(x,u,t)  = L^(x,u^)  on  t't^_j^,t^),  i = 1,2, ...,k,  (E.21) 


then 


aJ(u)/au^  = J tL|_^(x(t),u,t)  + J L^(x(T),u,T)*(T,t)dTf^(x(t),u^)  ]dt. 
^i-1  * 

(B.22) 

Combining  (E.I5)  and  (E.22)  leads  to 


3j(u)/au^=  AQ(9J(uj/Su^)  + n(Bh(Xj^(u))/au^) 
t^ 


+ \ J $^(T,t)L^(x(T),u,T)dT]^fy(x(t),u^)dt 
+ J ?^QL^(x(t),u,t)dt. 


(E.23) 


“i-1 

Now  let  p be  an  adjoint  vector  satisfying 
r 


1: 


P(t)  = -f]^(x(t),u(t))p(t)  - XjjL^(x(t),u(t),t), 
p(\)  = ^i(ah(xj^)/axj^)^. 


I ,u(  t),t)^ 


(E.2U) 


Equation  (E.24)  can  be  solved  to  yield 
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(E.25) 


p(t)  = t(t,tj^)p(\)  + I '|r(t,T)AQL^(x(T),U,T)dT, 

"t 

where  \^(t,T)  is  the  state  transition  matrix  for  the  adjoint 
(E.2k),  i.e. 


~ il>(t,T)  = -fJJ(x(t),u(t))\lr(t,T), 

\lr(T,T)  = I. 


It  is  well-known  that 


= ($‘^(t,T))’^  = $^(T,t), 


Now,  combining  (E.23),  (E.2U),  (E.25)  and  (E,27), 

?^J(u)/au^  = J [ApL^^(x(t),u,t)  + p'^(t)f^(x(t),u^;  Idt. 

*i-l 

We  can  further  simplify  (E.28)  by  introducing  the  Hamiltonian 


H(x,p,u,^p,t)  = AQL(x,u,t)  + p f(x,u). 


Then 


SJ(u)/3Uj^  = J OH/au)(x(t),p(t),u(t),XQ,t)dt. 


“i-1 


Note  that  since  L(x,u,t)  = L^(x,Uj^)  on  also 


write 


pi 

?^J(u)/au^  = J (aH^/c»u^)(x(t),p(t),u^,Ap)dt, 


by  defining 


i-1 


H^(x,p,u^,^q)  = 7\pLj(x,Uj)  +p  f(x,Uj). 


Thus , we  have 


llo 


system 


(E.26) 


(E.27) 


(E.26) 


(E.29) 


(E.30) 

can 


(E.3I) 


(E.32) 


Finally,  combining  (E.33)  a»3  (E.3),  we  have  the  desired  gradient 


(aH^/au^)(t)dt  +2A^(u*-u^) 

*0 

J ^ (aH2/au2)(t)dt  +2^2(4  ”^2) 

: 

■t 

\-l 

where 

(5H*/au^)(t)  = (9H^/Su^)(x*(t),p*(t),u*,A*).  (E.35) 


APPENDIX  F 


COEFFICIENTS  OF  THE  TWO -TEMPERATURE  MODEL 


(V.1.2a)  - (V.1.2d)  are  positive  constants  given  by 
A^  = o.iU8z^^^(az^2;)‘^, 

A^  = 1.86C^(NgZ)"^, 

B-  = 1.11A^/^(N  Z ZBR^)"^, 

2 ' e n 

Bj^  = 0.186n^(N^Z^Z)~^, 

C^  = o.56z|(Aj^)-^, 

(F.l) 

with 

= “e-Vl- 

(F.2) 

where  A and  (resp.  and  Z^)  are  the  mass  number  and  ionic 

charge  number  of  the  ions  (resp.  injected  neutral  particles)  respect- 
ively;  A^  and  Zj  are  the  mass  and  the  ionic  charge  numbers  of  the 
J-th  species  in  the  plasma  or  the  impurities;  N^,N^,N^  and  Nj  are 
respectively  the  number  densities  of  the  electrons,  ions,  neutrals 
and  the  ions  of  the  J-th  species  in  the  impurities;  Z^^^  and  Z are 
respectively  the  effective  and  the  modified  effective  charge  numbers; 

B is  the  toroidal  magnetic  field;  a and  R are  the  minor  and  major 
reuiii  of  the  plasma  torus  respectively,  and  Yj  is  the  correction 


*2  - 


>-l 


A^^  = 0.1l6Nj(NgZ) 

= 6.05>O.0"'*(a/R)V/^Z^^(Z^Z)’\ 
B^  = 5.2Xl0"3(a/R)^/^A^/^Z^^(Z^Z)"^ 
B^  = 1.86C2(N^Z)'^, 

C = A^/^Z 

2 n n j 
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Tin 


h * 


■f 


f J 

h 


I 9 


1 f 


1^^ 


! » 


1 » 


factor  for  the  Joule  heating  term  (including  trapped -particle  effects 
and  Z-correction)  . The  coefficient  depends  on  the  regime  of 


electron  diffusion.  In  the  cdlisional  regime  (T^  < T^),  a = 1/2, 


P = 0 and  = "^e^eff^e'^^^^  ’ Tn  anomaly  factor,  and 


is  the  transition  temperature  for  this  regime.  In  the  regime 


(T^  > T^)  where  the  electron-loss  is  dominated  by  trapped-electron 


instability,  we  have  a = 13/2,  p = 4 and  A = y N /(B‘Z  ), 

C © ©II  p© 


■^eff 


where  E = a/R  and  P =0.3  is  the  "poloidal  beta"  associated  with 

pe 


the  electrons. 

For  the  T.F.R.  experiments,  the  specific  values  for  vai’ious  para- 


meters are;  7j=2,  A = l,  Z^  = 1 , a=  2,  R=l,  Z^=2,  B=it,  Zj^=  1 , Aj^=l, 


Z Z=l/2,  N.  = 2,  = 3 and  W =5,  where  the  units  are  as 

' ■*  ' ' o 

,6 


eff  “ ■ *’1 

follows;  (KeV),  E(10  KeV),  1 (lO  amperes),  (lo'^  amperes), 

Ng,Nj  (10^^/cm^),  (lO^/cm^),  N^.  (lo^^  cm^) , a (10  cm),  R (100  cm) 

and  B (10  gauss). 

The  two-temperature  model  is  formulated  on  the  normalized  time 


scale  't  which  is  related  to  the  real  time  scale  t(m  sec)  by 

dT  = (:2eANj^Z^^)dt. 

The  constant  R in  the  cost  functional  (V.l.U)  is  given  by 


R = I.SPaAZ^-N^)  , 
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APPENDIX  G 

HAMILTONIANS  AND  ADJOINT  EQUATIONS  FOR  PLASMA  HEATING  PROBLEM 


The  Hamiltonians  (V.3.I)  and  (V.3*2)  in  Chapter  V are  given  in 
explicit  form  as  follows; 


H2(x,p,I,t)  = (Ep3T‘^/^  + - RE)I  - 

. P2{A3(T^  - TPt;3/2  . Sj^(T^;Ip)  - B^T^  . B^X^} 

+ P^[(C^t;3/2  ^ c2E"3/2)X^) 

+ PJ(C^T"3/2  ^ c2E’3/2)X2},  (G.l) 


H^(x,p,I,t)  = H2(x,p,I,t)  + REI.  (G.2) 

The  adjoint  equations  (V.3.10)  are  written  explicitly  below  in 


equation  (G.3).  Note  that  since  the  Jacobians  (dH^-^dx)  and  (dH^/dx)  are 


identical > the  adjoint  vector  p(t)  satisfies  the  same  differential 
equation  (G.3)  on  two  stages. 


Pi  ■ - i 


1 Pj(|  Aj(t^  - + Pjf|  t;5/Pei-| 

‘Pj-fCiXj), 

Pp  ■ Plf-*3P;^^^i  * «=Dl<’’l>Pp>''*Pl  •>  '>,!• 

P3  ■ Pl{‘*5)  ■*  P3{Vs^^^  * 

Pi.  ' Ppt-P;!  * (0-3) 


.1 


1 


1?0 


J 


I 

I 


I 
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